Apr 22 08:49:48 devstack cinder-volume[74103]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 08:49:48 devstack cinder-volume[74103]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 08:49:48 devstack cinder-volume[74103]: we strongly recommend against using it for new projects. Apr 22 08:49:48 devstack cinder-volume[74103]: If you are already using Eventlet, we recommend migrating to a different Apr 22 08:49:48 devstack cinder-volume[74103]: framework. For more detail see Apr 22 08:49:48 devstack cinder-volume[74103]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 08:49:48 devstack cinder-volume[74103]: import eventlet # noqa Apr 22 08:49:50 devstack cinder-volume[74103]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74103) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:49:50 devstack cinder-volume[74103]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74103) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:49:50 devstack cinder-volume[74103]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74103) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:49:50 devstack cinder-volume[74103]: INFO dbcounter [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Registered counter for database cinder Apr 22 08:49:50 devstack cinder-volume[74103]: DEBUG oslo_db.sqlalchemy.engines [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG dbcounter [-] [74103] Writer thread running {{(pid=74103) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.rpc [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.rpc [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_db.sqlalchemy.engines [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.volume.manager [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Determined volume DB was empty at startup. Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG cinder.volume.manager [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74103) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.volume.manager [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 22 08:49:51 devstack cinder-volume[74103]: WARNING stevedore.named [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 08:49:51 devstack cinder-volume[74103]: WARNING castellan.key_manager [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:49:51 devstack cinder-volume[74103]: WARNING cinder.keymgr.conf_key_mgr [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG cinder.volume.drivers.lvm [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74103) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_concurrency.processutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74103) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_concurrency.processutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] CMD "cinder-rtstool verify" returned: 0 in 0.252s {{(pid=74103) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_db.sqlalchemy.engines [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.rpc [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.rpc [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 22 08:49:51 devstack cinder-volume[74103]: WARNING stevedore.named [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 08:49:51 devstack cinder-volume[74103]: WARNING castellan.key_manager [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:49:51 devstack cinder-volume[74103]: INFO cinder.volume.manager [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_db.sqlalchemy.engines [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:49:51 devstack cinder-volume[74103]: INFO oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Starting 1 workers Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Started child 74205 {{(pid=74103) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Full set of CONF: {{(pid=74103) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] ******************************************************************************** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Configuration options gathered from: {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] ================================================================================ {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] allow_availability_zone_fallback = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] allow_compression_on_image_upload = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] allowed_direct_url_schemes = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] api_rate_limit = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] auth_strategy = keystone {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] az_cache_duration = 3600 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_availability_zone = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_host = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_stats_polling_interval = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backup_api_class = cinder.backup.api.API {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backup_name_template = backup-%s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backup_use_same_host = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backup_use_temp_snapshot = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] chap_password = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] chap_username = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_internal_tenant_project_id = 361f502068244f1a8f9eb38692076fa6 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_internal_tenant_user_id = 4b56100add1b4eaf9a05f76cea52a16a {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cloned_volume_same_az = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cluster = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] compression_format = gzip {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] compute_api_class = cinder.compute.nova.API {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] config_dir = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] config_source = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] control_exchange = openstack {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] debug = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] default_availability_zone = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] default_group_type = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] default_volume_type = lvmdriver-1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] disk_geometry = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] driver_client_cert = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] driver_client_cert_key = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] driver_data_namespace = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] driver_ssl_cert_path = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] driver_ssl_cert_verify = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] driver_use_ssl = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] enable_force_upload = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] enable_new_services = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] enable_unsupported_driver = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] enabled_backends = ['lvmdriver-1'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] enforce_multipath_for_image_xfer = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] filter_function = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_api_insecure = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_api_servers = ['http://192.168.122.222/image'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_api_ssl_compression = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_ca_certificates_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_catalog_info = image:glance:publicURL {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74205]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_num_retries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance_request_timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] goodness_function = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] graceful_shutdown_timeout = 5 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] group_api_class = cinder.group.api.API {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] host = devstack {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_compress_on_upload = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_conversion_address_space_limit = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_conversion_cpu_limit = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_conversion_disable = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_upload_use_cinder_backend = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_upload_use_internal_tenant = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_volume_cache_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_volume_cache_max_count = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] image_volume_cache_max_size_gb = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] init_host_max_objects_retrieval = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] instance_format = [instance: %(uuid)s] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] iscsi_target_flags = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] iscsi_write_cache = on {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] iser_helper = tgtadm {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] iser_ip_address = 192.168.122.222 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] iser_port = 3260 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_color = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_config_append = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_dir = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_options = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_rotate_interval = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_rotate_interval_type = days {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] log_rotation_type = none {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] max_age = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] max_logfile_count = 30 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] max_logfile_size_mb = 200 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] max_over_subscription_ratio = 20.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] message_reap_interval = 86400 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] message_ttl = 2592000 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] migration_create_volume_timeout_secs = 300 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] monkey_patch = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] monkey_patch_modules = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] my_ip = 192.168.122.222 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] no_snapshot_gb_quota = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] num_iser_scan_tries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] num_shell_tries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] num_volume_device_scan_tries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] nvmeof_conn_info_version = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] nvmet_ns_id = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] nvmet_port_id = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_max_limit = 1000 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_volume_ext_list = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_volume_listen = 0.0.0.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_volume_listen_port = 8776 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_volume_use_ssl = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] osapi_volume_workers = 2 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] per_volume_size_limit = -1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] periodic_fuzzy_delay = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] periodic_interval = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] project_id_regex = [0-9a-f\-]+ {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] public_endpoint = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] publish_errors = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_backup_gigabytes = 1000 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74205]: INFO cinder.volume.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_backups = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_gigabytes = 1000 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_groups = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_snapshots = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] quota_volumes = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] rate_limit_burst = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] rate_limit_except_level = CRITICAL {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] rate_limit_interval = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] reinit_driver_count = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] replication_device = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] report_discard_supported = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] report_interval = 120 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] reservation_clean_interval = 86400 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] reservation_expire = 86400 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] reserved_image_namespaces = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] reserved_percentage = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] rpc_response_timeout = 120 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] run_external_periodic_tasks = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] scst_target_driver = iscsi {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] scst_target_iqn_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_down_time = 720 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] shell_completion = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] snapshot_name_template = snapshot-%s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] snapshot_same_host = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] split_loggers = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] state_path = /opt/stack/data/cinder {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] storage_availability_zone = nova {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] storage_protocol = iSCSI {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] syslog_log_facility = LOG_USER {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] target_helper = lioadm {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] target_ip_address = 192.168.122.222 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] target_port = 3260 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] target_protocol = iscsi {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] target_secondary_ip_addresses = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] trace_flags = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] transfer_api_class = cinder.transfer.api.API {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] transport_url = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] until_refresh = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_chap_auth = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_default_quota_class = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_journal = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_json = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_multipath_for_image_xfer = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_stderr = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] use_syslog = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] verify_glance_signatures = enabled {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_api_class = cinder.volume.api.API {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_backend_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_clear = zero {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_clear_ionice = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_clear_size = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_copy_bps_limit = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_dd_blocksize = 1M {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_name_template = volume-%s {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_service_inithost_offload = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volume_usage_audit_period = month {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] zoning_mode = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_concurrency.disable_process_locking = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.admin_password = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.admin_token = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.admin_user = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_admin_prefix = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_port = 35357 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_protocol = https {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_section = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_type = password {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_uri = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.auth_version = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.cache = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.delay_auth_decision = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.http_connect_timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.identity_uri = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.include_service_catalog = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.insecure = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.interface = public {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_password = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcache_username = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.region_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.service_token_roles_required = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.service_type = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.token_cache_time = 300 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.222/identity {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.backend = dogpile.cache.null {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.backend_argument = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.backend_expiration_time = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.config_prefix = cache.oslo {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.debug_cache_backend = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.enable_retry_client = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.enable_socket_keepalive = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.enforce_fips_mode = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.expiration_time = 600 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.hashclient_retry_attempts = 2 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_dead_retry = 300 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_pool_maxsize = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_sasl_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.password = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.proxies = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.redis_db = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.redis_sentinel_service_name = mymaster {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.redis_server = localhost:6379 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.retry_attempts = 2 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.retry_delay = 0.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.socket_keepalive_count = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.socket_keepalive_idle = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.socket_keepalive_interval = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.socket_timeout = 1.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.tls_allowed_ciphers = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.tls_cafile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.tls_certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.tls_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.tls_keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cache.username = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] coordination.backend_url = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.asyncio_connection = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.asyncio_slave_connection = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.backend = sqlalchemy {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.connection = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.connection_debug = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.connection_parameters = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.connection_recycle_time = 3600 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.connection_trace = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.db_inc_retry_interval = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.db_max_retries = 20 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.db_max_retry_interval = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.db_retry_interval = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.max_overflow = 50 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.max_pool_size = 5 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.max_retries = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.mysql_wsrep_sync_wait = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.pool_timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.retry_interval = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.slave_connection = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.sqlite_synchronous = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.synchronous_reader = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] database.use_db_reconnect = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.connection_string = messaging:// {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.es_doc_type = notification {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.es_scroll_size = 10000 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.es_scroll_time = 2m {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.filter_error_trace = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.hmac_keys = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.sentinel_service_name = mymaster {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.socket_timeout = 0.1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.trace_requests = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler.trace_sqlalchemy = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler_jaeger.process_tags = {} {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler_jaeger.service_name_prefix = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] profiler_otlp.service_name_prefix = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.enforce_new_defaults = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: WARNING oslo_config.cfg [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.enforce_scope = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.policy_default_rule = default {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.policy_file = policy.yaml {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_policy.remote_timeout = 60.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.group = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.helper_command = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] privsep_osbrick.user = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.group = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.helper_command = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] cinder_sys_admin.user = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.auth_section = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.auth_type = password {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.cafile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.collect_timing = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.insecure = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.send_service_user_token = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.split_loggers = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] service_user.timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.auth_section = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.auth_type = password {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.collect_timing = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.insecure = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.region_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.split_loggers = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] glance.timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.backend_availability_zone = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.chap_password = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.chap_username = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.disk_geometry = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.driver_client_cert = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.driver_client_cert_key = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.driver_data_namespace = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.driver_use_ssl = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.enable_unsupported_driver = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.extra_capabilities = {} {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.filter_function = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.goodness_function = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.iscsi_target_flags = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.iscsi_write_cache = on {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.iser_helper = tgtadm {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.iser_ip_address = 192.168.122.222 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.iser_port = 3260 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.lvm_mirrors = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.lvm_share_target = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.lvm_type = auto {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.num_shell_tries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.nvmet_port_id = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.replication_device = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.report_discard_supported = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.reserved_percentage = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.scst_target_driver = iscsi {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.scst_target_iqn_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.storage_protocol = iSCSI {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.target_helper = tgtadm {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.target_ip_address = 192.168.122.222 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.target_port = 3260 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.target_protocol = iscsi {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.trace_flags = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.unique_fqdn_network = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.use_chap_auth = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_backend_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_clear = zero {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_clear_ionice = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_clear_size = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volume_group = cinder-volumes {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_reports.file_event_handler = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_reports.log_dir = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.backend_availability_zone = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.backend_host = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.chap_password = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.chap_username = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.chiscsi_conf = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.disk_geometry = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.driver_client_cert = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.driver_data_namespace = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.driver_use_ssl = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.extra_capabilities = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.filter_function = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.goodness_function = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.iser_helper = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.iser_ip_address = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.iser_port = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.iser_target_prefix = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.lvm_conf_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.lvm_mirrors = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.lvm_share_target = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.lvm_type = auto {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.num_shell_tries = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.nvmet_port_id = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.replication_device = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.report_discard_supported = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.reserved_percentage = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.scst_target_driver = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.storage_protocol = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.target_helper = lioadm {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.target_ip_address = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.target_port = 3260 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.target_protocol = iscsi {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.trace_flags = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.use_chap_auth = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_clear = zero {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_clear_size = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] lvmdriver-1.volumes_dir = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.ssl = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.ssl_version = {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_notifications.driver = [] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_notifications.retry = -1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] oslo_messaging_notifications.transport_url = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] key_manager.fixed_key = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.barbican_api_version = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.barbican_endpoint = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.barbican_endpoint_type = public {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.barbican_region_name = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.cafile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.collect_timing = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.insecure = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.number_of_retries = 60 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.retry_delay = 1 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.send_service_user_token = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.split_loggers = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.verify_ssl = True {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican.verify_ssl_path = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.auth_section = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.auth_type = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.cafile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.certfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.collect_timing = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.insecure = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.keyfile = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.split_loggers = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] barbican_service_user.timeout = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.approle_role_id = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.approle_secret_id = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.081s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.kv_mountpoint = secret {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.kv_path = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.kv_version = 2 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.namespace = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.root_token_id = **** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.ssl_ca_crt_file = None {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.timeout = 60.0 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.use_ssl = False {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:49:51 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] ******************************************************************************** {{(pid=74103) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 08:49:51 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:51 devstack sudo[74217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 22 08:49:51 devstack sudo[74217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:52 devstack sudo[74217]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.535s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:52 devstack sudo[74264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:52 devstack sudo[74264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:52 devstack sudo[74264]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.516s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:49:52 devstack cinder-volume[74205]: INFO cinder.brick.local_dev.lvm [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:52 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:52 devstack sudo[74494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:49:52 devstack sudo[74494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:53 devstack sudo[74494]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:53 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:53 devstack cinder-volume[74205]: DEBUG cinder.brick.local_dev.lvm [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74205) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 22 08:49:53 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:53 devstack sudo[74703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:53 devstack sudo[74703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:54 devstack sudo[74703]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.003s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:54 devstack sudo[74886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:54 devstack sudo[74886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:54 devstack sudo[74886]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:54 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:54 devstack sudo[74906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 22 08:49:54 devstack sudo[74906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:55 devstack sudo[74906]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:55 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.472s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:55 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:55 devstack sudo[74909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:49:55 devstack sudo[74909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:55 devstack sudo[74909]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:55 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:55 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:55 devstack sudo[74914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:49:55 devstack sudo[74914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:56 devstack sudo[74914]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:56 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:56 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:56 devstack sudo[74920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:49:56 devstack sudo[74920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:56 devstack sudo[74920]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:56 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:56 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:56 devstack sudo[74926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:56 devstack sudo[74926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:57 devstack sudo[74926]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:57 devstack sudo[74930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:57 devstack sudo[74930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:57 devstack sudo[74930]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:57 devstack cinder-volume[74205]: INFO cinder.volume.drivers.lvm [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:57 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:57 devstack sudo[74940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:57 devstack sudo[74940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:58 devstack sudo[74940]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:58 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:58 devstack cinder-volume[74205]: DEBUG cinder.volume.drivers.lvm [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Updating volume stats {{(pid=74205) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 08:49:58 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:58 devstack sudo[75055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:49:58 devstack sudo[75055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:58 devstack sudo[75055]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:58 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:58 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:58 devstack sudo[75195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:49:58 devstack sudo[75195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:59 devstack sudo[75195]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:59 devstack sudo[75198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:49:59 devstack sudo[75198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:59 devstack sudo[75198]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:49:59 devstack sudo[75201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:49:59 devstack sudo[75201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:49:59 devstack sudo[75201]: pam_unix(sudo:session): session closed for user root Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:49:59 devstack cinder-volume[74205]: INFO cinder.volume.driver [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Driver hasn't implemented _init_vendor_properties() Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG cinder.volume.driver [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74205) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG oslo_db.sqlalchemy.engines [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG dbcounter [-] [74205] Writer thread running {{(pid=74205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG cinder.db.sqlalchemy.api [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Building query based on filter {{(pid=74205) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG cinder.image.image_utils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74205) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 22 08:49:59 devstack cinder-volume[74205]: INFO cinder.keymgr.migration [None req-7de97cef-f066-4bf5-9332-070ff58dde2c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 08:49:59 devstack cinder-volume[74205]: DEBUG cinder.volume.drivers.lvm [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Updating volume stats {{(pid=74205) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 08:50:00 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:00 devstack sudo[75209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:50:00 devstack sudo[75209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:00 devstack sudo[75209]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:00 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:00 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:00 devstack sudo[75213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:50:00 devstack sudo[75213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:00 devstack sudo[75213]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:00 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:00 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:00 devstack sudo[75216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:50:00 devstack sudo[75216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:01 devstack sudo[75216]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:01 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:01 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:01 devstack sudo[75221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:50:01 devstack sudo[75221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:01 devstack cinder-volume[74103]: DEBUG dbcounter [-] [74103] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74103) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:50:01 devstack sudo[75221]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:01 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:01 devstack cinder-volume[74205]: DEBUG cinder.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Notifying Schedulers of capabilities ... {{(pid=74205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:50:01 devstack cinder-volume[74205]: INFO cinder.volume.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Driver initialization completed successfully. Apr 22 08:50:01 devstack cinder-volume[74205]: INFO cinder.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Initiating service 2 cleanup Apr 22 08:50:01 devstack cinder-volume[74205]: INFO cinder.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Service 2 cleanup completed. Apr 22 08:50:01 devstack cinder-volume[74205]: DEBUG cinder.service [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Creating RPC server for service cinder-volume {{(pid=74205) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 08:50:01 devstack cinder-volume[74205]: DEBUG cinder.service [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74205) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 08:50:02 devstack cinder-volume[74205]: INFO cinder.volume.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 22 08:50:02 devstack cinder-volume[74205]: DEBUG cinder.volume.drivers.lvm [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Updating volume stats {{(pid=74205) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 08:50:02 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:02 devstack sudo[75230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:50:02 devstack sudo[75230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:02 devstack sudo[75230]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:02 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:02 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:02 devstack sudo[75272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:50:02 devstack sudo[75272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:02 devstack sudo[75272]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:02 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:02 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:02 devstack sudo[75290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:50:02 devstack sudo[75290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:03 devstack sudo[75290]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:03 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:03 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:50:03 devstack sudo[75293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:50:03 devstack sudo[75293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:50:03 devstack sudo[75293]: pam_unix(sudo:session): session closed for user root Apr 22 08:50:03 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:50:03 devstack cinder-volume[74205]: INFO cinder.volume.manager [None req-b88f56ce-4a07-4d04-88ef-90ec89eaa3db None None] Driver post RPC initialization completed successfully. Apr 22 08:50:11 devstack cinder-volume[74205]: DEBUG dbcounter [-] [74205] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:50:13 devstack cinder-volume[74205]: DEBUG dbcounter [-] [74205] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=74205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:51:15 devstack cinder-volume[74205]: DEBUG oslo_service.periodic_task [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:51:15 devstack cinder-volume[74205]: DEBUG cinder.volume.drivers.lvm [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Updating volume stats {{(pid=74205) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 08:51:15 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:51:15 devstack sudo[80045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:51:15 devstack sudo[80045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:51:16 devstack sudo[80045]: pam_unix(sudo:session): session closed for user root Apr 22 08:51:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:51:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:51:16 devstack sudo[80052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:51:16 devstack sudo[80052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:51:16 devstack sudo[80052]: pam_unix(sudo:session): session closed for user root Apr 22 08:51:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:51:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:51:16 devstack sudo[80064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:51:16 devstack sudo[80064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:51:17 devstack sudo[80064]: pam_unix(sudo:session): session closed for user root Apr 22 08:51:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:51:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:51:17 devstack sudo[80068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:51:17 devstack sudo[80068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:51:17 devstack sudo[80068]: pam_unix(sudo:session): session closed for user root Apr 22 08:51:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:51:17 devstack cinder-volume[74205]: DEBUG cinder.manager [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Notifying Schedulers of capabilities ... {{(pid=74205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:52:13 devstack cinder-volume[74205]: DEBUG dbcounter [-] [74205] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:52:15 devstack cinder-volume[74205]: DEBUG oslo_service.periodic_task [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:52:15 devstack cinder-volume[74205]: DEBUG cinder.volume.drivers.lvm [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Updating volume stats {{(pid=74205) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 08:52:15 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:52:15 devstack sudo[81808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:52:15 devstack sudo[81808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:52:16 devstack sudo[81808]: pam_unix(sudo:session): session closed for user root Apr 22 08:52:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:52:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:52:16 devstack sudo[81845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:52:16 devstack sudo[81845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:52:16 devstack sudo[81845]: pam_unix(sudo:session): session closed for user root Apr 22 08:52:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:52:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:52:16 devstack sudo[81860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:52:16 devstack sudo[81860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:52:17 devstack sudo[81860]: pam_unix(sudo:session): session closed for user root Apr 22 08:52:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:52:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:52:17 devstack sudo[81883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:52:17 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:52:17 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root Apr 22 08:52:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:52:17 devstack cinder-volume[74205]: DEBUG cinder.manager [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Notifying Schedulers of capabilities ... {{(pid=74205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:53:15 devstack cinder-volume[74205]: DEBUG oslo_service.periodic_task [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:53:15 devstack cinder-volume[74205]: DEBUG cinder.volume.drivers.lvm [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Updating volume stats {{(pid=74205) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 08:53:15 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:15 devstack sudo[83027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 08:53:15 devstack sudo[83027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:16 devstack sudo[83027]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:16 devstack sudo[83097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:53:16 devstack sudo[83097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:16 devstack sudo[83097]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:16 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:16 devstack sudo[83125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 08:53:16 devstack sudo[83125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:17 devstack sudo[83125]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:17 devstack sudo[83144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 08:53:17 devstack sudo[83144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:17 devstack sudo[83144]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:17 devstack cinder-volume[74205]: DEBUG oslo_concurrency.processutils [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=74205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:17 devstack cinder-volume[74205]: DEBUG cinder.manager [None req-fd6bb307-4def-4626-b438-16b004b0a161 None None] Notifying Schedulers of capabilities ... {{(pid=74205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:53:19 devstack cinder-volume[74103]: INFO oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Caught SIGTERM, stopping children Apr 22 08:53:19 devstack cinder-volume[74103]: DEBUG oslo_concurrency.lockutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Acquiring lock "singleton_lock" {{(pid=74103) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:53:19 devstack cinder-volume[74103]: DEBUG oslo_concurrency.lockutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Acquired lock "singleton_lock" {{(pid=74103) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:53:19 devstack cinder-volume[74103]: DEBUG oslo_concurrency.lockutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Releasing lock "singleton_lock" {{(pid=74103) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:53:19 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Stop services. {{(pid=74103) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 22 08:53:19 devstack cinder-volume[74103]: DEBUG oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Killing children. {{(pid=74103) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 22 08:53:19 devstack cinder-volume[74103]: INFO oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Waiting on 1 children to exit Apr 22 08:53:22 devstack cinder-volume[74205]: DEBUG oslo_concurrency.lockutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Acquiring lock "singleton_lock" {{(pid=74205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:53:22 devstack cinder-volume[74205]: DEBUG oslo_concurrency.lockutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Acquired lock "singleton_lock" {{(pid=74205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:53:22 devstack cinder-volume[74205]: DEBUG oslo_concurrency.lockutils [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Releasing lock "singleton_lock" {{(pid=74205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:53:22 devstack cinder-volume[74205]: WARNING amqp [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 08:53:22 devstack cinder-volume[74205]: WARNING amqp [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 08:53:22 devstack cinder-volume[74103]: INFO oslo_service.backend._eventlet.service [None req-db530cb7-5210-45c4-824a-26f644c3d54f None None] Child 74205 exited with status 0 Apr 22 08:53:22 devstack cinder-volume[83268]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 08:53:22 devstack cinder-volume[83268]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 08:53:22 devstack cinder-volume[83268]: we strongly recommend against using it for new projects. Apr 22 08:53:22 devstack cinder-volume[83268]: If you are already using Eventlet, we recommend migrating to a different Apr 22 08:53:22 devstack cinder-volume[83268]: framework. For more detail see Apr 22 08:53:22 devstack cinder-volume[83268]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 08:53:22 devstack cinder-volume[83268]: import eventlet # noqa Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:53:24 devstack cinder-volume[83268]: INFO dbcounter [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Registered counter for database cinder Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG oslo_db.sqlalchemy.engines [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG dbcounter [-] [83268] Writer thread running {{(pid=83268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 08:53:24 devstack cinder-volume[83268]: INFO cinder.rpc [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 08:53:24 devstack cinder-volume[83268]: INFO cinder.rpc [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG oslo_db.sqlalchemy.engines [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:24 devstack cinder-volume[83268]: INFO cinder.volume.manager [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Determined volume DB was empty at startup. Apr 22 08:53:24 devstack cinder-volume[83268]: DEBUG cinder.volume.manager [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83268) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 22 08:53:24 devstack cinder-volume[83268]: INFO cinder.volume.manager [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 22 08:53:24 devstack cinder-volume[83268]: WARNING stevedore.named [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 08:53:24 devstack cinder-volume[83268]: WARNING castellan.key_manager [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:53:24 devstack cinder-volume[83268]: WARNING cinder.keymgr.conf_key_mgr [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:53:25 devstack cinder-volume[83268]: INFO cinder.volume.manager [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_db.sqlalchemy.engines [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:25 devstack cinder-volume[83268]: INFO oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Starting 1 workers Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Started child 83385 {{(pid=83268) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Full set of CONF: {{(pid=83268) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] ******************************************************************************** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Configuration options gathered from: {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] ================================================================================ {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] allow_availability_zone_fallback = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] allow_compression_on_image_upload = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] allowed_direct_url_schemes = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] api_rate_limit = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] auth_strategy = keystone {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_availability_zone = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_host = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_stats_polling_interval = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backup_api_class = cinder.backup.api.API {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backup_name_template = backup-%s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backup_use_same_host = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backup_use_temp_snapshot = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] chap_password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] chap_username = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_internal_tenant_project_id = 361f502068244f1a8f9eb38692076fa6 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_internal_tenant_user_id = 4b56100add1b4eaf9a05f76cea52a16a {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cluster = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] compression_format = gzip {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] compute_api_class = cinder.compute.nova.API {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] config_dir = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] config_source = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] control_exchange = openstack {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] debug = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] default_availability_zone = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] default_group_type = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] default_volume_type = QuobyteHD {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] disk_geometry = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] driver_client_cert = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] driver_client_cert_key = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] driver_data_namespace = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] driver_ssl_cert_path = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] driver_ssl_cert_verify = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] driver_use_ssl = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] enable_new_services = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] enable_unsupported_driver = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83385]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] enabled_backends = ['QuobyteHD'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] enforce_multipath_for_image_xfer = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] filter_function = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_api_insecure = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_api_servers = ['http://192.168.122.222/image'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_api_ssl_compression = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_ca_certificates_file = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_catalog_info = image:glance:publicURL {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_num_retries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance_request_timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] goodness_function = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] graceful_shutdown_timeout = 5 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] group_api_class = cinder.group.api.API {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] host = devstack {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_compress_on_upload = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_conversion_address_space_limit = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_conversion_cpu_limit = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_conversion_disable = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_upload_use_cinder_backend = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_upload_use_internal_tenant = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_volume_cache_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_volume_cache_max_count = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] image_volume_cache_max_size_gb = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] init_host_max_objects_retrieval = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] instance_format = [instance: %(uuid)s] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] iscsi_target_flags = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] iscsi_write_cache = on {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] iser_helper = tgtadm {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] iser_ip_address = 192.168.122.222 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] iser_port = 3260 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_color = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_config_append = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_dir = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_file = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_options = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_rotate_interval = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_rotate_interval_type = days {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] log_rotation_type = none {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] max_age = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] max_logfile_count = 30 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] max_logfile_size_mb = 200 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] max_over_subscription_ratio = 20.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] message_reap_interval = 86400 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] message_ttl = 2592000 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] migration_create_volume_timeout_secs = 300 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] monkey_patch = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] monkey_patch_modules = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] my_ip = 192.168.122.222 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] no_snapshot_gb_quota = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] num_iser_scan_tries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] num_shell_tries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] num_volume_device_scan_tries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] nvmeof_conn_info_version = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] nvmet_ns_id = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] nvmet_port_id = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_max_limit = 1000 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_volume_ext_list = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_volume_listen = 0.0.0.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_volume_listen_port = 8776 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_volume_use_ssl = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] osapi_volume_workers = 2 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] per_volume_size_limit = -1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] periodic_fuzzy_delay = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] periodic_interval = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] project_id_regex = [0-9a-f\-]+ {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] public_endpoint = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] publish_errors = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_backup_gigabytes = 1000 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_backups = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83385]: INFO cinder.volume.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Starting volume driver QuobyteDriver (1.1.14) Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.remotefs [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83385) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_gigabytes = 1000 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_groups = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_snapshots = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] quota_volumes = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] rate_limit_burst = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] rate_limit_except_level = CRITICAL {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] rate_limit_interval = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] reinit_driver_count = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] replication_device = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] report_discard_supported = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] report_interval = 120 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] reservation_clean_interval = 86400 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] reservation_expire = 86400 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] reserved_image_namespaces = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] reserved_percentage = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] rpc_response_timeout = 120 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] run_external_periodic_tasks = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] scst_target_driver = iscsi {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] scst_target_iqn_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_down_time = 720 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] shell_completion = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] snapshot_name_template = snapshot-%s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] split_loggers = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] state_path = /opt/stack/data/cinder {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] storage_availability_zone = nova {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] storage_protocol = iSCSI {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] syslog_log_facility = LOG_USER {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] target_helper = lioadm {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] target_ip_address = 192.168.122.222 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] target_port = 3260 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] target_protocol = iscsi {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] target_secondary_ip_addresses = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] trace_flags = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] transfer_api_class = cinder.transfer.api.API {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] transport_url = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] until_refresh = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_chap_auth = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_default_quota_class = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_journal = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_json = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_multipath_for_image_xfer = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_stderr = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] use_syslog = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] verify_glance_signatures = enabled {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_api_class = cinder.volume.api.API {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_backend_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_clear = zero {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_clear_ionice = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_clear_size = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_copy_bps_limit = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_dd_blocksize = 1M {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_name_template = volume-%s {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_service_inithost_offload = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volume_usage_audit_period = month {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] zoning_mode = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_concurrency.disable_process_locking = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.admin_password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.admin_token = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.admin_user = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_admin_prefix = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_port = 35357 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_protocol = https {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_section = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_type = password {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_uri = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.auth_version = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.cache = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.delay_auth_decision = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.http_connect_timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.identity_uri = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.include_service_catalog = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.insecure = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.interface = public {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_password = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcache_username = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.region_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.service_token_roles_required = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.service_type = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.token_cache_time = 300 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.222/identity {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.backend = dogpile.cache.null {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.backend_argument = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.backend_expiration_time = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.config_prefix = cache.oslo {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.debug_cache_backend = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.enable_retry_client = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.enable_socket_keepalive = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.enforce_fips_mode = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.expiration_time = 600 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.hashclient_retry_attempts = 2 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_dead_retry = 300 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_pool_maxsize = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_sasl_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.proxies = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.redis_db = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.redis_sentinel_service_name = mymaster {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.redis_server = localhost:6379 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.retry_attempts = 2 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.retry_delay = 0.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.socket_keepalive_count = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.socket_keepalive_idle = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.socket_keepalive_interval = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.socket_timeout = 1.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.tls_allowed_ciphers = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.tls_cafile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.tls_certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.tls_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.tls_keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cache.username = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] coordination.backend_url = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.asyncio_connection = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.asyncio_slave_connection = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.backend = sqlalchemy {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.connection = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.connection_debug = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.connection_parameters = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.connection_recycle_time = 3600 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.connection_trace = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.db_inc_retry_interval = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.db_max_retries = 20 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.db_max_retry_interval = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.db_retry_interval = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.max_overflow = 50 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.max_pool_size = 5 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.max_retries = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.mysql_wsrep_sync_wait = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.pool_timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.retry_interval = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.slave_connection = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.sqlite_synchronous = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.synchronous_reader = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] database.use_db_reconnect = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.connection_string = messaging:// {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.es_doc_type = notification {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.es_scroll_size = 10000 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.es_scroll_time = 2m {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.filter_error_trace = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.hmac_keys = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.sentinel_service_name = mymaster {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.socket_timeout = 0.1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.trace_requests = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler.trace_sqlalchemy = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler_jaeger.process_tags = {} {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler_jaeger.service_name_prefix = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] profiler_otlp.service_name_prefix = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.enforce_new_defaults = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: WARNING oslo_config.cfg [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.enforce_scope = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.policy_default_rule = default {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.policy_file = policy.yaml {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_policy.remote_timeout = 60.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.group = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.helper_command = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] privsep_osbrick.user = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.group = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.helper_command = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] cinder_sys_admin.user = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.auth_section = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.auth_type = password {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.cafile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.collect_timing = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.insecure = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.send_service_user_token = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.split_loggers = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] service_user.timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.auth_section = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.auth_type = password {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.collect_timing = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.insecure = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.region_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.split_loggers = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] glance.timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.backend_availability_zone = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.chap_password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.chap_username = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.disk_geometry = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.driver_client_cert = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.driver_client_cert_key = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.driver_data_namespace = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.driver_use_ssl = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.enable_unsupported_driver = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.extra_capabilities = {} {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.filter_function = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.goodness_function = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.iscsi_target_flags = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.iscsi_write_cache = on {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.iser_helper = tgtadm {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.iser_ip_address = 192.168.122.222 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.iser_port = 3260 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_host = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_login = admin {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_mount_options = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_private_key = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_share_path = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_ssh_port = 22 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.num_shell_tries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.nvmet_port_id = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_client_cfg = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.quobyte_volume_url = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.replication_device = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.report_discard_supported = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.reserved_percentage = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.scst_target_driver = iscsi {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.scst_target_iqn_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.storage_protocol = iSCSI {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.target_helper = tgtadm {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.target_ip_address = 192.168.122.222 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.target_port = 3260 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.target_protocol = iscsi {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.trace_flags = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.unique_fqdn_network = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.use_chap_auth = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_backend_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_clear = zero {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_clear_ionice = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_clear_size = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_reports.file_event_handler = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_reports.log_dir = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.backend_availability_zone = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.backend_host = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.chap_password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.chap_username = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.chiscsi_conf = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.disk_geometry = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.driver_client_cert = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.driver_client_cert_key = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.driver_data_namespace = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.driver_use_ssl = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.extra_capabilities = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.filter_function = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.goodness_function = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.iscsi_target_flags = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.iscsi_write_cache = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.iser_helper = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.iser_ip_address = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.iser_port = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.iser_target_prefix = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_host = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_login = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_mount_options = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_password = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_private_key = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_share_path = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_ssh_port = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.num_shell_tries = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nvmet_ns_id = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.nvmet_port_id = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.replication_device = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.report_discard_supported = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.reserved_percentage = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.scst_target_driver = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.storage_protocol = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.target_helper = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.target_ip_address = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.target_port = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.target_prefix = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.target_protocol = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.trace_flags = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.unique_fqdn_network = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.use_chap_auth = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_clear = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_clear_ionice = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_clear_size = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] QuobyteHD.volumes_dir = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.ssl = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.ssl_version = {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_notifications.driver = [] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_notifications.retry = -1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] key_manager.fixed_key = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.barbican_api_version = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.barbican_endpoint = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.barbican_endpoint_type = public {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.barbican_region_name = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.cafile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.collect_timing = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.insecure = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.number_of_retries = 60 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.retry_delay = 1 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.send_service_user_token = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.split_loggers = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.verify_ssl = True {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican.verify_ssl_path = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.auth_section = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.auth_type = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.cafile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.certfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.collect_timing = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.insecure = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.keyfile = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.split_loggers = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] barbican_service_user.timeout = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.approle_role_id = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.approle_secret_id = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.kv_mountpoint = secret {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.kv_path = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.kv_version = 2 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.namespace = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.root_token_id = **** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.ssl_ca_crt_file = None {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.timeout = 60.0 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.use_ssl = False {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:25 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] ******************************************************************************** {{(pid=83268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83385) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 22 08:53:25 devstack cinder-volume[83385]: WARNING cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 22 08:53:25 devstack cinder-volume[83385]: WARNING cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Running cmd (subprocess): mount.quobyte {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:25 devstack quobyte-client[83389]: Reading configuration file: /etc/quobyte/client.cfg Apr 22 08:53:25 devstack quobyte-client[83389]: Invalid parameters found, error: missing mount point. Apr 22 08:53:25 devstack quobyte-client[83389]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 22 08:53:25 devstack quobyte-client[83389]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:53:25 devstack cinder-volume[83385]: INFO cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 ... Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab -c /etc/quobyte/client-cinder.cfg {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:25 devstack sudo[83390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab -c /etc/quobyte/client-cinder.cfg Apr 22 08:53:25 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:25 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.477s {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:25 devstack cinder-volume[83385]: INFO cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 succeeded Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.487s {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:53:25 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:25 devstack sudo[83459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:53:25 devstack sudo[83459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:26 devstack sudo[83459]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.483s {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:26 devstack cinder-volume[83385]: INFO cinder.volume.driver [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Driver hasn't implemented _init_vendor_properties() Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG cinder.volume.driver [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7232131958008, 'free_capacity_gb': 1775.7232131958008, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83385) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG oslo_db.sqlalchemy.engines [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG dbcounter [-] [83385] Writer thread running {{(pid=83385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG cinder.db.sqlalchemy.api [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Building query based on filter {{(pid=83385) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG cinder.image.image_utils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83385) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 22 08:53:26 devstack cinder-volume[83385]: INFO cinder.keymgr.migration [None req-3224d62e-01b5-4bd1-835b-52982ede19e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:53:26 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:26 devstack sudo[83469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:53:26 devstack sudo[83469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:27 devstack sudo[83469]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.644s {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG cinder.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Notifying Schedulers of capabilities ... {{(pid=83385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:53:27 devstack cinder-volume[83385]: INFO cinder.volume.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Driver initialization completed successfully. Apr 22 08:53:27 devstack cinder-volume[83385]: INFO cinder.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Initiating service 3 cleanup Apr 22 08:53:27 devstack cinder-volume[83385]: INFO cinder.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Service 3 cleanup completed. Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG cinder.service [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Creating RPC server for service cinder-volume {{(pid=83385) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG cinder.service [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83385) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 08:53:27 devstack cinder-volume[83385]: INFO cinder.volume.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG cinder.volume.drivers.quobyte [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83385) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:27 devstack sudo[83524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:53:27 devstack sudo[83524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:27 devstack sudo[83524]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:27 devstack cinder-volume[83385]: DEBUG oslo_concurrency.processutils [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.455s {{(pid=83385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:27 devstack cinder-volume[83385]: INFO cinder.volume.manager [None req-a0946cbb-a212-485c-8be2-c6c8734c58db None None] Driver post RPC initialization completed successfully. Apr 22 08:53:29 devstack cinder-volume[83268]: INFO oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Caught SIGTERM, stopping children Apr 22 08:53:29 devstack cinder-volume[83268]: DEBUG oslo_concurrency.lockutils [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Acquiring lock "singleton_lock" {{(pid=83268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:53:29 devstack cinder-volume[83268]: DEBUG oslo_concurrency.lockutils [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Acquired lock "singleton_lock" {{(pid=83268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:53:29 devstack cinder-volume[83268]: DEBUG oslo_concurrency.lockutils [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Releasing lock "singleton_lock" {{(pid=83268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:53:29 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Stop services. {{(pid=83268) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 22 08:53:29 devstack cinder-volume[83268]: DEBUG oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Killing children. {{(pid=83268) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 22 08:53:29 devstack cinder-volume[83268]: INFO oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Waiting on 1 children to exit Apr 22 08:53:31 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Acquiring lock "singleton_lock" {{(pid=83385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:53:31 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Acquired lock "singleton_lock" {{(pid=83385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:53:31 devstack cinder-volume[83385]: DEBUG oslo_concurrency.lockutils [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Releasing lock "singleton_lock" {{(pid=83385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:53:31 devstack cinder-volume[83385]: WARNING amqp [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 08:53:31 devstack cinder-volume[83385]: WARNING amqp [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 08:53:31 devstack cinder-volume[83268]: INFO oslo_service.backend._eventlet.service [None req-91cbc949-92ab-47b6-872c-8cb4f5dd0b7a None None] Child 83385 exited with status 0 Apr 22 08:53:31 devstack cinder-volume[83607]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 08:53:31 devstack cinder-volume[83607]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 08:53:31 devstack cinder-volume[83607]: we strongly recommend against using it for new projects. Apr 22 08:53:31 devstack cinder-volume[83607]: If you are already using Eventlet, we recommend migrating to a different Apr 22 08:53:31 devstack cinder-volume[83607]: framework. For more detail see Apr 22 08:53:31 devstack cinder-volume[83607]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 08:53:31 devstack cinder-volume[83607]: import eventlet # noqa Apr 22 08:53:33 devstack cinder-volume[83607]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83607) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 08:53:33 devstack cinder-volume[83607]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83607) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 08:53:33 devstack cinder-volume[83607]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83607) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 08:53:33 devstack cinder-volume[83607]: INFO dbcounter [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Registered counter for database cinder Apr 22 08:53:33 devstack cinder-volume[83607]: DEBUG oslo_db.sqlalchemy.engines [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83607) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG dbcounter [-] [83607] Writer thread running {{(pid=83607) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 08:53:34 devstack cinder-volume[83607]: INFO cinder.rpc [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 08:53:34 devstack cinder-volume[83607]: INFO cinder.rpc [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_db.sqlalchemy.engines [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83607) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:34 devstack cinder-volume[83607]: INFO cinder.volume.manager [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Determined volume DB was empty at startup. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG cinder.volume.manager [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83607) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 22 08:53:34 devstack cinder-volume[83607]: WARNING stevedore.named [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 08:53:34 devstack cinder-volume[83607]: WARNING castellan.key_manager [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:53:34 devstack cinder-volume[83607]: WARNING cinder.keymgr.conf_key_mgr [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 08:53:34 devstack cinder-volume[83607]: INFO cinder.volume.manager [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_db.sqlalchemy.engines [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83607) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:34 devstack cinder-volume[83607]: INFO oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Starting 1 workers Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Started child 83774 {{(pid=83607) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Full set of CONF: {{(pid=83607) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] ******************************************************************************** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 08:53:34 devstack cinder-volume[83774]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Configuration options gathered from: {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] ================================================================================ {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] allow_availability_zone_fallback = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] allow_compression_on_image_upload = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] allowed_direct_url_schemes = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] api_rate_limit = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] auth_strategy = keystone {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_availability_zone = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_host = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_stats_polling_interval = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backup_api_class = cinder.backup.api.API {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backup_name_template = backup-%s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backup_use_same_host = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backup_use_temp_snapshot = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] chap_password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] chap_username = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_internal_tenant_project_id = 361f502068244f1a8f9eb38692076fa6 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_internal_tenant_user_id = 4b56100add1b4eaf9a05f76cea52a16a {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cluster = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] compression_format = gzip {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] compute_api_class = cinder.compute.nova.API {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] config_dir = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] config_source = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] control_exchange = openstack {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] debug = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] default_availability_zone = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] default_group_type = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] default_volume_type = QuobyteHD {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] disk_geometry = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] driver_client_cert = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] driver_client_cert_key = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] driver_data_namespace = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] driver_ssl_cert_path = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] driver_ssl_cert_verify = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] driver_use_ssl = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] enable_new_services = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] enable_unsupported_driver = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] enabled_backends = ['QuobyteHD'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] enforce_multipath_for_image_xfer = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] filter_function = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_api_insecure = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_api_servers = ['http://192.168.122.222/image'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83774) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_api_ssl_compression = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_ca_certificates_file = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_catalog_info = image:glance:publicURL {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_num_retries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance_request_timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] goodness_function = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] graceful_shutdown_timeout = 5 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] group_api_class = cinder.group.api.API {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] host = devstack {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_compress_on_upload = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_conversion_address_space_limit = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_conversion_cpu_limit = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_conversion_disable = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_upload_use_cinder_backend = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_upload_use_internal_tenant = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_volume_cache_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_volume_cache_max_count = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] image_volume_cache_max_size_gb = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] init_host_max_objects_retrieval = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] instance_format = [instance: %(uuid)s] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] iscsi_target_flags = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] iscsi_write_cache = on {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] iser_helper = tgtadm {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] iser_ip_address = 192.168.122.222 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] iser_port = 3260 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_color = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_config_append = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_dir = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_file = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_options = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_rotate_interval = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_rotate_interval_type = days {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] log_rotation_type = none {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] max_age = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] max_logfile_count = 30 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] max_logfile_size_mb = 200 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] max_over_subscription_ratio = 20.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] message_reap_interval = 86400 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] message_ttl = 2592000 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] migration_create_volume_timeout_secs = 300 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] monkey_patch = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] monkey_patch_modules = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] my_ip = 192.168.122.222 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] no_snapshot_gb_quota = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] num_iser_scan_tries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] num_shell_tries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] num_volume_device_scan_tries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack quobyte-client[83792]: Reading configuration file: /etc/quobyte/client.cfg Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] nvmeof_conn_info_version = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] nvmet_ns_id = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] nvmet_port_id = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_max_limit = 1000 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_volume_ext_list = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack quobyte-client[83792]: Invalid parameters found, error: missing mount point. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_volume_listen_port = 8776 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_volume_use_ssl = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] osapi_volume_workers = 2 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] per_volume_size_limit = -1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] periodic_fuzzy_delay = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] periodic_interval = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack quobyte-client[83792]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] public_endpoint = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] publish_errors = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_backup_gigabytes = 1000 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_backups = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_gigabytes = 1000 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_groups = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack quobyte-client[83792]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_snapshots = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] quota_volumes = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] rate_limit_burst = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] rate_limit_except_level = CRITICAL {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] rate_limit_interval = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] reinit_driver_count = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] replication_device = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] report_discard_supported = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] report_interval = 120 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] reservation_clean_interval = 86400 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] reservation_expire = 86400 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] reserved_image_namespaces = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] reserved_percentage = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] rpc_response_timeout = 120 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] run_external_periodic_tasks = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] scst_target_driver = iscsi {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] scst_target_iqn_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_down_time = 720 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] shell_completion = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] snapshot_name_template = snapshot-%s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] split_loggers = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] state_path = /opt/stack/data/cinder {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] storage_availability_zone = nova {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] storage_protocol = iSCSI {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] syslog_log_facility = LOG_USER {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] target_helper = lioadm {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] target_ip_address = 192.168.122.222 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] target_port = 3260 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] target_protocol = iscsi {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] target_secondary_ip_addresses = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] trace_flags = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83774) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] transport_url = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 22 08:53:34 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] until_refresh = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_chap_auth = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_default_quota_class = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Running cmd (subprocess): mount.quobyte {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_journal = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_json = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_multipath_for_image_xfer = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_stderr = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] use_syslog = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] verify_glance_signatures = enabled {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_api_class = cinder.volume.api.API {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_backend_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_clear = zero {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_clear_ionice = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_clear_size = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_copy_bps_limit = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_dd_blocksize = 1M {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_name_template = volume-%s {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_service_inithost_offload = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volume_usage_audit_period = month {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] zoning_mode = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_concurrency.disable_process_locking = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.admin_password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.admin_token = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.admin_user = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_port = 35357 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_protocol = https {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_section = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_type = password {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_uri = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.auth_version = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.cache = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.identity_uri = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.include_service_catalog = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.insecure = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.interface = public {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_password = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcache_username = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.region_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.service_type = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.222/identity {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.backend = dogpile.cache.null {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.backend_argument = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.backend_expiration_time = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.config_prefix = cache.oslo {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.debug_cache_backend = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.enable_retry_client = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.enable_socket_keepalive = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.enforce_fips_mode = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.expiration_time = 600 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.hashclient_retry_attempts = 2 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_dead_retry = 300 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_pool_maxsize = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_sasl_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.proxies = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.redis_db = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.redis_server = localhost:6379 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.retry_attempts = 2 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.retry_delay = 0.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.socket_keepalive_count = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.socket_keepalive_idle = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.socket_keepalive_interval = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.socket_timeout = 1.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.tls_allowed_ciphers = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.tls_cafile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.tls_certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.tls_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.tls_keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cache.username = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] coordination.backend_url = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.asyncio_connection = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.asyncio_slave_connection = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.backend = sqlalchemy {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.connection = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.connection_debug = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.connection_parameters = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.connection_recycle_time = 3600 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.connection_trace = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.db_inc_retry_interval = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.db_max_retries = 20 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.db_max_retry_interval = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.db_retry_interval = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.max_overflow = 50 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.max_pool_size = 5 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.max_retries = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.mysql_wsrep_sync_wait = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.pool_timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.retry_interval = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.slave_connection = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.sqlite_synchronous = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.synchronous_reader = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] database.use_db_reconnect = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.connection_string = messaging:// {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.es_doc_type = notification {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.es_scroll_size = 10000 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.es_scroll_time = 2m {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.filter_error_trace = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.hmac_keys = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.sentinel_service_name = mymaster {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.socket_timeout = 0.1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.trace_requests = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler.trace_sqlalchemy = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler_jaeger.process_tags = {} {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler_jaeger.service_name_prefix = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] profiler_otlp.service_name_prefix = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.enforce_new_defaults = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: WARNING oslo_config.cfg [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.enforce_scope = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.policy_default_rule = default {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.policy_file = policy.yaml {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.group = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.helper_command = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] privsep_osbrick.user = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.group = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.helper_command = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] cinder_sys_admin.user = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.auth_section = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.auth_type = password {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.cafile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.collect_timing = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.insecure = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.send_service_user_token = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.split_loggers = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] service_user.timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.auth_section = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.auth_type = password {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.collect_timing = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.insecure = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.region_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.split_loggers = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] glance.timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.backend_availability_zone = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.chap_password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.chap_username = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.disk_geometry = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.driver_client_cert = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.driver_client_cert_key = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.driver_data_namespace = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.driver_use_ssl = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.extra_capabilities = {} {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.filter_function = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.goodness_function = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] CMD "mount.quobyte" returned: 1 in 0.095s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.iscsi_target_flags = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.iscsi_write_cache = on {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.iser_helper = tgtadm {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.iser_ip_address = 192.168.122.222 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.iser_port = 3260 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_host = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_login = admin {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_mount_options = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_private_key = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_share_path = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.num_shell_tries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.quobyte_volume_url = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.replication_device = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.report_discard_supported = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.reserved_percentage = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.target_helper = tgtadm {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.target_ip_address = 192.168.122.222 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.target_port = 3260 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.target_protocol = iscsi {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.trace_flags = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.unique_fqdn_network = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.use_chap_auth = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_backend_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_clear = zero {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_clear_ionice = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_clear_size = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_reports.file_event_handler = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_reports.log_dir = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.backend_availability_zone = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.backend_host = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.chap_password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.chap_username = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.chiscsi_conf = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.disk_geometry = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.driver_client_cert = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.driver_data_namespace = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.driver_use_ssl = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.extra_capabilities = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.filter_function = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.goodness_function = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.iser_helper = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.iser_ip_address = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.iser_port = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.iser_target_prefix = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_host = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_login = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_mount_options = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_password = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_private_key = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_share_path = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_ssh_port = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.num_shell_tries = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.nvmet_port_id = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.replication_device = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.report_discard_supported = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.reserved_percentage = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.scst_target_driver = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.storage_protocol = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.target_helper = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.target_ip_address = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.target_port = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.target_prefix = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.target_protocol = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.trace_flags = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.use_chap_auth = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_clear = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_clear_size = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] QuobyteHD.volumes_dir = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.ssl = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_notifications.driver = [] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_notifications.retry = -1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] key_manager.fixed_key = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.barbican_api_version = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.barbican_endpoint = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.barbican_endpoint_type = public {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.barbican_region_name = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.cafile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.collect_timing = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.insecure = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.number_of_retries = 60 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.retry_delay = 1 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.send_service_user_token = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.split_loggers = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.verify_ssl = True {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican.verify_ssl_path = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.auth_section = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.auth_type = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.cafile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.certfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.collect_timing = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.insecure = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.keyfile = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.split_loggers = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] barbican_service_user.timeout = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.approle_role_id = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.approle_secret_id = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.kv_mountpoint = secret {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.kv_path = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.kv_version = 2 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.namespace = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.root_token_id = **** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.ssl_ca_crt_file = None {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.timeout = 60.0 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.use_ssl = False {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 08:53:34 devstack cinder-volume[83607]: DEBUG oslo_service.backend._eventlet.service [None req-02463d4f-a1c4-4c43-acf7-55d91db53b88 None None] ******************************************************************************** {{(pid=83607) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 08:53:34 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.517s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:34 devstack cinder-volume[83774]: INFO cinder.volume.driver [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Driver hasn't implemented _init_vendor_properties() Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.driver [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83774) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83774) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writer thread running {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.db.sqlalchemy.api [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Building query based on filter {{(pid=83774) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83774) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:53:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:34 devstack cinder-volume[83774]: INFO cinder.keymgr.migration [None req-9ed1e2d7-d239-4587-be2b-b72411edec40 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 08:53:34 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:53:34 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:35 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.415s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:53:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Driver initialization completed successfully. Apr 22 08:53:35 devstack cinder-volume[83774]: INFO cinder.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Initiating service 3 cleanup Apr 22 08:53:35 devstack cinder-volume[83774]: INFO cinder.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Service 3 cleanup completed. Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG cinder.service [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Creating RPC server for service cinder-volume {{(pid=83774) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG cinder.service [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83774) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 08:53:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:53:35 devstack sudo[83858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:53:35 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:53:35 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root Apr 22 08:53:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.400s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:53:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5cd1494e-7369-458d-ad48-ab5f5a691c81 None None] Driver post RPC initialization completed successfully. Apr 22 08:53:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6cd7af12-a866-443c-9ec5-c24f04eedc8e tempest-BackendsCapabilitiesAdminTestsJSON-828276846 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83774) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 22 08:53:44 devstack cinder-volume[83607]: DEBUG dbcounter [-] [83607] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83607) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:53:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8fabbf2e-453c-492a-bf1c-9febf7847747 tempest-BackendsCapabilitiesAdminTestsJSON-828276846 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83774) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 22 08:53:45 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:54:33 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:54:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Flow 'volume_create_manager' (67d08ef8-ac28-40c7-8a3d-358eaf5c8dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d8ef39-a968-48ba-8d36-2834be355812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c252895e-7ade-4222-a187-74a30f1f0a64 tempest-GroupSnapshotsTest-1445376737 None] Group tempest-GroupSnapshotsTest-Group-1531915375: creating Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d8ef39-a968-48ba-8d36-2834be355812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1937203052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc90144-435f-4fda-a637-fb1924f7783d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9f58c7d8d76444abe5170491b567d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:34Z,use_quota=True,user_id='57bb2a19ad65444c8e4af32d5a18e619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f7255b-2024-4dbd-96ab-4a409124900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f7255b-2024-4dbd-96ab-4a409124900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e12e91-fea2-4d67-9275-72831c53bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e12e91-fea2-4d67-9275-72831c53bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc90144-435f-4fda-a637-fb1924f7783d', 'volume_name': 'volume-fcc90144-435f-4fda-a637-fb1924f7783d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682f2295-1088-478a-abbb-8a676cd90039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682f2295-1088-478a-abbb-8a676cd90039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a328001-98df-4c4c-bfa4-75f1eec92b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Volume fcc90144-435f-4fda-a637-fb1924f7783d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc90144-435f-4fda-a637-fb1924f7783d', 'volume_size': 1} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1937203052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc90144-435f-4fda-a637-fb1924f7783d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9f58c7d8d76444abe5170491b567d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:34Z,use_quota=True,user_id='57bb2a19ad65444c8e4af32d5a18e619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Creating volume fcc90144-435f-4fda-a637-fb1924f7783d {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:54:34 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:34 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d 1073741824 Apr 22 08:54:34 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c252895e-7ade-4222-a187-74a30f1f0a64 tempest-GroupSnapshotsTest-1445376737 None] Group tempest-GroupSnapshotsTest-Group-1531915375: created successfully Apr 22 08:54:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c252895e-7ade-4222-a187-74a30f1f0a64 tempest-GroupSnapshotsTest-1445376737 None] Create group completed successfully. Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Flow 'volume_create_manager' (d61d5e40-2482-43db-8eaf-2ee33617b153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c912b729-21a0-4daa-8d2b-5456f327267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c912b729-21a0-4daa-8d2b-5456f327267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-29440987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6af87a0-dcd9-4cfb-925b-597cf76b8aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a66007216f34916820ef576a2fafec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:34Z,use_quota=True,user_id='1b1ab49112c54f4199029c7149a94be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c021025-c23c-4a95-af82-54c5ee39b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c021025-c23c-4a95-af82-54c5ee39b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c805bcfd-98e9-4494-8473-dc320cac84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c805bcfd-98e9-4494-8473-dc320cac84dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6af87a0-dcd9-4cfb-925b-597cf76b8aba', 'volume_name': 'volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585dc79b-502b-4193-bd4f-cc82d95289e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585dc79b-502b-4193-bd4f-cc82d95289e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bb3919-fe35-4b46-9b41-7f603996cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Volume c6af87a0-dcd9-4cfb-925b-597cf76b8aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba', 'volume_size': 1} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:34 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d 1073741824" returned: 0 in 0.612s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:54:34 devstack sudo[84568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d Apr 22 08:54:34 devstack sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (a5db5b5c-1dd5-495c-bd4d-7f1ca447719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52007a93-da7a-444a-93a0-9c27521d4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52007a93-da7a-444a-93a0-9c27521d4588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-603473563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3124a16b-8e1b-4086-905a-cdc07d66699f,host='devstack@QuobyteHD#QuobyteHD',id=b5fc49a0-6342-4b74-90a6-c715040a1253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:35Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f47477b4-b8a1-4903-a6dc-6fdb8588dbf1),volume_type_id=f47477b4-b8a1-4903-a6dc-6fdb8588dbf1)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196769aa-d48b-451b-8858-f919234163c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196769aa-d48b-451b-8858-f919234163c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd486f66-2b8e-4c7e-9305-dd1ff48974ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd486f66-2b8e-4c7e-9305-dd1ff48974ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fc49a0-6342-4b74-90a6-c715040a1253', 'volume_name': 'volume-b5fc49a0-6342-4b74-90a6-c715040a1253', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b2e00f-17f2-4e4b-a6f5-8c634a7f0d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b2e00f-17f2-4e4b-a6f5-8c634a7f0d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cd99fa-e14e-4db2-9d99-3949ca6135a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Volume b5fc49a0-6342-4b74-90a6-c715040a1253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fc49a0-6342-4b74-90a6-c715040a1253', 'volume_size': 1} Apr 22 08:54:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:35 devstack sudo[84568]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d" returned: 0 in 0.521s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-29440987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6af87a0-dcd9-4cfb-925b-597cf76b8aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a66007216f34916820ef576a2fafec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:34Z,use_quota=True,user_id='1b1ab49112c54f4199029c7149a94be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Creating volume c6af87a0-dcd9-4cfb-925b-597cf76b8aba {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:54:35 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a328001-98df-4c4c-bfa4-75f1eec92b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc90144-435f-4fda-a637-fb1924f7783d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ceacfc-ad48-4118-a8df-697b22c4db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:35 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba 1073741824 Apr 22 08:54:35 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:35 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Volume volume-fcc90144-435f-4fda-a637-fb1924f7783d (fcc90144-435f-4fda-a637-fb1924f7783d): created successfully Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ceacfc-ad48-4118-a8df-697b22c4db89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Flow 'volume_create_manager' (67d08ef8-ac28-40c7-8a3d-358eaf5c8dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-c91aad74-97cb-4e7d-b43c-2e46d4590bdf req-d4cbc555-1674-4763-a1ac-d90f65daf3f1 tempest-VolumesGetTestJSON-1495953117 None] Created volume successfully. Apr 22 08:54:35 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba 1073741824" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:35 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba Apr 22 08:54:35 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:36 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" returned: 0 in 0.724s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3124a16b-8e1b-4086-905a-cdc07d66699f,created_at=2026-04-22T06:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-603473563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3124a16b-8e1b-4086-905a-cdc07d66699f,host='devstack@QuobyteHD#QuobyteHD',id=b5fc49a0-6342-4b74-90a6-c715040a1253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:35Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f47477b4-b8a1-4903-a6dc-6fdb8588dbf1),volume_type_id=f47477b4-b8a1-4903-a6dc-6fdb8588dbf1)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Creating volume b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:54:36 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bb3919-fe35-4b46-9b41-7f603996cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300343bc-848f-49a1-bcf3-8abf5760b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:36 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Volume volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba (c6af87a0-dcd9-4cfb-925b-597cf76b8aba): created successfully Apr 22 08:54:36 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 1073741824 Apr 22 08:54:36 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300343bc-848f-49a1-bcf3-8abf5760b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Flow 'volume_create_manager' (d61d5e40-2482-43db-8eaf-2ee33617b153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-44373738-4926-4e55-9e9f-8664c956b287 tempest-DeleteServersTestJSON-1357817594 None] Created volume successfully. Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Acquiring lock "cinder-fcc90144-435f-4fda-a637-fb1924f7783d-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Lock "cinder-fcc90144-435f-4fda-a637-fb1924f7783d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Acquiring lock "cinder-quobyte-fcc90144-435f-4fda-a637-fb1924f7783d" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Lock "cinder-quobyte-fcc90144-435f-4fda-a637-fb1924f7783d" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:36 devstack cinder-volume[83774]: INFO oslo.privsep.daemon [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu_3pemf5/privsep.sock'] Apr 22 08:54:36 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu_3pemf5/privsep.sock Apr 22 08:54:36 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 22 08:54:37 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 1073741824" returned: 0 in 1.025s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:37 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:54:37 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 08:54:37 devstack cinder-volume[83774]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 22 08:54:38 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.711s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cd99fa-e14e-4db2-9d99-3949ca6135a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fc49a0-6342-4b74-90a6-c715040a1253', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ad95a-fc4b-4c4f-8a5c-a64747c58784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:38 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Volume volume-b5fc49a0-6342-4b74-90a6-c715040a1253 (b5fc49a0-6342-4b74-90a6-c715040a1253): created successfully Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ad95a-fc4b-4c4f-8a5c-a64747c58784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (a5db5b5c-1dd5-495c-bd4d-7f1ca447719c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1bfd47e9-6c21-479b-814a-5779c01bb091 tempest-GroupSnapshotsTest-1445376737 None] Created volume successfully. Apr 22 08:54:38 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:38 devstack cinder-volume[83774]: INFO oslo.privsep.daemon [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Spawned new privsep daemon via rootwrap Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Accepted privsep connection to /tmp/tmpu_3pemf5/privsep.sock {{(pid=83774) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 22 08:54:38 devstack cinder-volume[83774]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 22 08:54:38 devstack cinder-volume[83774]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 22 08:54:38 devstack cinder-volume[83774]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 22 08:54:38 devstack cinder-volume[83774]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84646 Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[886ba4ed-e32a-4c37-ba4a-6bbf810ddaee]: (2,) {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c0ebe-fe7a-45a3-a028-3db4fed698b0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:38 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d Apr 22 08:54:38 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:38 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d" returned: 0 in 0.502s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:38 devstack sudo[84660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d Apr 22 08:54:38 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:39 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fcc90144-435f-4fda-a637-fb1924f7783d" returned: 0 in 0.627s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Lock "cinder-quobyte-fcc90144-435f-4fda-a637-fb1924f7783d" released by "delete_volume" :: held 2.787s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Flow 'volume_create_manager' (7975b1dd-ec3f-4ebc-9c08-64b5d449d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067eb0f0-48fb-4178-82a0-bf357fdab3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067eb0f0-48fb-4178-82a0-bf357fdab3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-941563232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb44bfd0ab24e168062527db30fd78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:39Z,use_quota=True,user_id='f1fb24ea71bb49cf8db867cc5cf5a246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be80925-bae7-4f2d-8abd-47c7ab3901ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be80925-bae7-4f2d-8abd-47c7ab3901ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b6605b-0fc2-471b-b954-4c8b75f622ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b6605b-0fc2-471b-b954-4c8b75f622ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1', 'volume_name': 'volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e83b05-39c9-452d-af35-5761ea40250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e83b05-39c9-452d-af35-5761ea40250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb23383-53a3-4acb-96cd-26d7d98a4ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:39 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Volume 1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1', 'volume_size': 1} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-941563232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb44bfd0ab24e168062527db30fd78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:39Z,use_quota=True,user_id='f1fb24ea71bb49cf8db867cc5cf5a246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Creating volume 1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:54:39 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:39 devstack cinder-volume[83774]: WARNING cinder.quota [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:54:39 devstack cinder-volume[83774]: WARNING cinder.quota [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:54:39 devstack sudo[84665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 1073741824 Apr 22 08:54:39 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] GroupSnapshot c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d: creating. Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Group snapshot c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d: creating. {{(pid=83774) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.quota [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Created reservations ['62edc1ea-5593-47b1-9c75-620872c80a83', '323443d6-8a90-4192-a14f-9dfdd3618c1a', 'f125fe8b-47f2-4775-86cd-c436a359f425', '81f0e277-8fef-4446-97eb-3d2576591dbf'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:39 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:54:39 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:40 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 1073741824" returned: 0 in 0.602s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:40 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 Apr 22 08:54:40 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:40 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.932s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:40 devstack cinder-volume[83774]: DEBUG cinder.manager [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:54:40 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Deleted volume successfully. Apr 22 08:54:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-c8f8ae3c-7059-4731-bed3-f7836f5cd111 req-ba247802-0d72-4898-ab65-4ba1a6c00563 tempest-VolumesGetTestJSON-1495953117 None] Lock "cinder-fcc90144-435f-4fda-a637-fb1924f7783d-delete_volume" released by "delete_volume" :: held 4.125s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:40 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1" returned: 0 in 0.731s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.283s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Creating offline snapshot 2412dab3-7f83-4676-b67a-60a666f73c7a of volume b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb23383-53a3-4acb-96cd-26d7d98a4ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3595e5c-2fb8-4b18-8b1a-308f64d9d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Volume volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 (1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1): created successfully Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3595e5c-2fb8-4b18-8b1a-308f64d9d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Flow 'volume_create_manager' (7975b1dd-ec3f-4ebc-9c08-64b5d449d29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ef53eec5-ee2d-480e-a7a3-1895eef25a08 tempest-VolumesAdminNegativeTest-1518247587 None] Created volume successfully. Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a8cc1-cb9f-4cb5-9d88-757d9f59563e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:41 devstack sudo[84681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:54:41 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:42 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.917s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:42 devstack sudo[84720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a 1G Apr 22 08:54:42 devstack sudo[84720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Acquiring lock "cinder-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "cinder-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Acquiring lock "cinder-quobyte-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "cinder-quobyte-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1" acquired by "delete_volume" :: waited 0.039s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13ba350-736a-4c80-8dc4-2f1b8b1df43e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:42 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 Apr 22 08:54:42 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:43 devstack sudo[84720]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a 1G" returned: 0 in 0.988s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc49a0-6342-4b74-90a6-c715040a1253 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:43 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc49a0-6342-4b74-90a6-c715040a1253 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a Apr 22 08:54:43 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:43 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1" returned: 0 in 1.069s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:43 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1 Apr 22 08:54:43 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:43 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc49a0-6342-4b74-90a6-c715040a1253 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a" returned: 0 in 0.862s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:43 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:54:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:43 devstack sudo[84749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a Apr 22 08:54:43 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:44 devstack cinder-volume[83774]: WARNING py.warnings [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 22 08:54:44 devstack cinder-volume[83774]: .first() Apr 22 08:54:44 devstack cinder-volume[83774]: Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:44 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1" returned: 0 in 0.630s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "cinder-quobyte-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1" released by "delete_volume" :: held 1.765s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Created reservations ['608e1fe1-7b5b-4fb5-b089-55131a5519e0', 'f748c02b-99db-40a6-a027-cc2224a433ec', 'f4626855-da3b-4db4-8360-895b0047b936', 'c9750821-3321-46cf-abb0-4ac964ecebd8'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:44 devstack sudo[84753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:54:44 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:44 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a" returned: 0 in 0.726s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:44 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info Apr 22 08:54:44 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:44 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.578s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:54:44 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Deleted volume successfully. Apr 22 08:54:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-62e2d24d-c32e-4092-aff4-c49b920acca1 tempest-VolumesAdminNegativeTest-1518247587 None] Lock "cinder-1f9e0807-0d3f-4ba6-81ec-701d8ca6dac1-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:45 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info" returned: 0 in 0.540s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:45 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:45 devstack sudo[84760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info Apr 22 08:54:45 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:45 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.info" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.701s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.585s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f193db-e199-41fc-89a7-ad019786b158]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7aecc6b2-f1ed-47fa-9d2f-0a0a9941e178 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d: created successfully Apr 22 08:54:45 devstack sudo[84766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba Apr 22 08:54:45 devstack sudo[84766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:46 devstack sudo[84766]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" returned: 0 in 0.656s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.694s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4', 'name': 'volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a5a0d48-c013-472d-8930-21b74198ffbd', 'enforce_multipath': True} {{(pid=83774) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 22 08:54:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-d10efc91-1ace-41b3-9d63-baec1618eaf1 req-ee0c83a6-1482-44c4-903f-cdbebb91fb48 tempest-DeleteServersTestJSON-1357817594 None] attachment_update completed successfully. Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-2412dab3-7f83-4676-b67a-60a666f73c7a-08d8908a-a163-4f64-aea8-a4c5cebb265e" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2412dab3-7f83-4676-b67a-60a666f73c7a-08d8908a-a163-4f64-aea8-a4c5cebb265e" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Creating volume 08d8908a-a163-4f64-aea8-a4c5cebb265e from snapshot 2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-08d8908a-a163-4f64-aea8-a4c5cebb265e" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-08d8908a-a163-4f64-aea8-a4c5cebb265e" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] snapshot: 2412dab3-7f83-4676-b67a-60a666f73c7a, volume: 08d8908a-a163-4f64-aea8-a4c5cebb265e, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c65e4-408d-431b-88f6-cc8eaa64c09d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:47 devstack sudo[84867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a Apr 22 08:54:47 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:48 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a" returned: 0 in 0.895s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc49a0-6342-4b74-90a6-c715040a1253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:54:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 08:54:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 08:54:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12c1b61-349a-4ec0-bdff-e203c1b90c1c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:48 devstack sudo[85193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:54:48 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:49 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.723s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:49 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 08:54:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:49 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e Apr 22 08:54:49 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Flow 'volume_create_manager' (9a94c428-6be4-45c4-8d18-f948dc519a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988788b-a681-44b5-8c21-c409b3206a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988788b-a681-44b5-8c21-c409b3206a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-490506567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391b4853-3abf-497a-9be4-ee97c0c9e68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4328a1ed72d244979658871e59dd99f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:51Z,use_quota=True,user_id='f163edee8ef0461a8205982543853694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146b990f-1678-4959-a7d7-b6098aabd110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146b990f-1678-4959-a7d7-b6098aabd110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0647eff3-e60d-49b7-a46f-065ea8285f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0647eff3-e60d-49b7-a46f-065ea8285f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391b4853-3abf-497a-9be4-ee97c0c9e68f', 'volume_name': 'volume-391b4853-3abf-497a-9be4-ee97c0c9e68f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11baf467-a065-4e8a-9839-ff777953f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11baf467-a065-4e8a-9839-ff777953f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aac98a1-dc1b-4e67-95cb-e199912d2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:51 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Volume 391b4853-3abf-497a-9be4-ee97c0c9e68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391b4853-3abf-497a-9be4-ee97c0c9e68f', 'volume_size': 1} Apr 22 08:54:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:52 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e" returned: 0 in 3.340s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52a8217-f774-476f-ad11-ef8ff9d5ccd4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:52 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:54:52 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:53 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.699s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253, size 1024.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:54:53 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Converted 1024.00 MB image at 306.50 MB/s Apr 22 08:54:53 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:53 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e Apr 22 08:54:53 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:53 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e" returned: 0 in 0.482s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-08d8908a-a163-4f64-aea8-a4c5cebb265e" released by "_copy_volume_from_snapshot" :: held 6.271s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2412dab3-7f83-4676-b67a-60a666f73c7a-08d8908a-a163-4f64-aea8-a4c5cebb265e" released by "_create_volume_from_snapshot" :: held 6.310s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.348s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.887s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-490506567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391b4853-3abf-497a-9be4-ee97c0c9e68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4328a1ed72d244979658871e59dd99f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:54:51Z,use_quota=True,user_id='f163edee8ef0461a8205982543853694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Creating volume 391b4853-3abf-497a-9be4-ee97c0c9e68f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:54:53 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:54:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:53 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f 1073741824 Apr 22 08:54:53 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-870c5b61-75de-4038-9c4a-23511f97c96d tempest-GroupSnapshotsTest-1445376737 None] Create group from source-snapshot-c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d completed successfully. Apr 22 08:54:54 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f 1073741824" returned: 0 in 0.732s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:54 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f Apr 22 08:54:54 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-08d8908a-a163-4f64-aea8-a4c5cebb265e" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-08d8908a-a163-4f64-aea8-a4c5cebb265e" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:54 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8bffb-3c4a-4029-ac16-63b4883b6c67]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:55 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f" returned: 0 in 0.502s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:55 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e Apr 22 08:54:55 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aac98a1-dc1b-4e67-95cb-e199912d2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391b4853-3abf-497a-9be4-ee97c0c9e68f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe29f190-3e56-42c9-a1e8-75bf38c83128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:54:55 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Volume volume-391b4853-3abf-497a-9be4-ee97c0c9e68f (391b4853-3abf-497a-9be4-ee97c0c9e68f): created successfully Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe29f190-3e56-42c9-a1e8-75bf38c83128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Flow 'volume_create_manager' (9a94c428-6be4-45c4-8d18-f948dc519a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:54:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-38cbd5af-5987-43e6-b27c-78537cd7cc9c tempest-VolumeQuotasNegativeTestJSON-54129067 None] Created volume successfully. Apr 22 08:54:55 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e" returned: 0 in 0.628s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:55 devstack sudo[85321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e Apr 22 08:54:55 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:56 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-08d8908a-a163-4f64-aea8-a4c5cebb265e" returned: 0 in 0.567s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-08d8908a-a163-4f64-aea8-a4c5cebb265e" released by "delete_volume" :: held 1.220s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['6339f428-4100-4828-afdd-1747eefb08f7'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:54:56 devstack cinder-volume[83774]: WARNING cinder.quota [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1418434547 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1418434547, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:54:56 devstack cinder-volume[83774]: WARNING cinder.quota [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1418434547 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1418434547, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['ca3c9503-85c3-48bb-a3bd-f1e84b60be6f', '30879483-400c-470d-9b13-0eb9b47f6d7d', '1c64ee75-561a-484e-afb9-3d7ce6671ce8', 'e573ba88-47e1-49f5-96e2-ca6f75cbcd24'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Acquiring lock "cinder-391b4853-3abf-497a-9be4-ee97c0c9e68f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "cinder-391b4853-3abf-497a-9be4-ee97c0c9e68f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Acquiring lock "cinder-quobyte-391b4853-3abf-497a-9be4-ee97c0c9e68f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "cinder-quobyte-391b4853-3abf-497a-9be4-ee97c0c9e68f" acquired by "delete_volume" :: waited 0.021s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4505d1-4276-485d-8e17-1e46a2992674]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:56 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:54:56 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:56 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f Apr 22 08:54:56 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:56 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-8fdda916-eba6-4cce-88d7-fbad9d02d24a req-4fc4b88a-37e9-4d90-b6a0-a1ba93c5ebbe tempest-DeleteServersTestJSON-1357817594 None] Terminate volume connection completed successfully. Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-8fdda916-eba6-4cce-88d7-fbad9d02d24a req-4fc4b88a-37e9-4d90-b6a0-a1ba93c5ebbe tempest-DeleteServersTestJSON-1357817594 None] Deleting attachment 0a5a0d48-c013-472d-8930-21b74198ffbd. {{(pid=83774) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 22 08:54:56 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f" returned: 0 in 0.529s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:56 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f Apr 22 08:54:56 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:56 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.558s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:56 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:54:56 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-49ec49bb-87c1-4a57-a8dd-89ffa2868e14 tempest-GroupSnapshotsTest-1445376737 None] Delete group completed successfully. Apr 22 08:54:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d: deleting Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d: deleting {{(pid=83774) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-b5fc49a0-6342-4b74-90a6-c715040a1253" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-b5fc49a0-6342-4b74-90a6-c715040a1253" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-2412dab3-7f83-4676-b67a-60a666f73c7a" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2412dab3-7f83-4676-b67a-60a666f73c7a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Deleting offline snapshot 2412dab3-7f83-4676-b67a-60a666f73c7a of volume b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] snapshot_file for this snap is: volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01de2b5-93ab-4dab-b6b7-f0b362ae7fde]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:57 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-391b4853-3abf-497a-9be4-ee97c0c9e68f" returned: 0 in 0.533s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:57 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a Apr 22 08:54:57 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "cinder-quobyte-391b4853-3abf-497a-9be4-ee97c0c9e68f" released by "delete_volume" :: held 1.109s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Created reservations ['5da73ffb-1b86-4d51-805d-b49dd5e14121', '38f8f3af-16c1-45b9-a2be-7f02b765a09e', '3e7e43d7-ac61-46e4-a7e7-c25dfb152c6f', '418a7bc8-33b9-4a13-b14b-26a8b2378b17'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:57 devstack sudo[85342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:54:57 devstack sudo[85342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:57 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a" returned: 0 in 0.561s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc49a0-6342-4b74-90a6-c715040a1253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f64bb1-7adb-4da8-8d7e-1755e32016d8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:54:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:57 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:54:57 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:58 devstack sudo[85342]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.557s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:58 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:54:58 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Deleted volume successfully. Apr 22 08:54:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a07b3fe7-a169-48c1-ab1c-401df3ce2794 tempest-VolumeQuotasNegativeTestJSON-54129067 None] Lock "cinder-391b4853-3abf-497a-9be4-ee97c0c9e68f-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:58 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.529s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:58 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a Apr 22 08:54:58 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:59 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a" returned: 0 in 0.594s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:54:59 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a Apr 22 08:54:59 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:54:59 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 22 08:54:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253.2412dab3-7f83-4676-b67a-60a666f73c7a" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:54:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2412dab3-7f83-4676-b67a-60a666f73c7a" released by "_delete_snapshot" :: held 2.220s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-b5fc49a0-6342-4b74-90a6-c715040a1253" released by "delete_snapshot" :: held 2.236s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:54:59 devstack cinder-volume[83774]: WARNING cinder.quota [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1418434547 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1418434547, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:54:59 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['b709ae9b-45e9-45a1-8f70-c8bfc7322b5c', '0826d68d-b8de-4472-8754-8649228e9691', 'e4c177be-47f8-429d-8bc5-a26344bc9ecf', 'dd06f94f-8d82-4818-b567-428d26819d5f'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:54:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e3afea5f-1348-4ae2-9856-056522000046 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot c5e9e8a4-8585-4d2c-a7fe-22ff710fac7d: deleted successfully Apr 22 08:55:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-b5fc49a0-6342-4b74-90a6-c715040a1253" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-b5fc49a0-6342-4b74-90a6-c715040a1253" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea6b680-b4d1-4082-99d8-ef41ce601ab4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:00 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:55:00 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Acquiring lock "cinder-c6af87a0-dcd9-4cfb-925b-597cf76b8aba-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Lock "cinder-c6af87a0-dcd9-4cfb-925b-597cf76b8aba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Acquiring lock "cinder-quobyte-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Lock "cinder-quobyte-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9af18b-7cdc-481f-bde3-e6deeaa159d1]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:01 devstack sudo[85367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba Apr 22 08:55:01 devstack sudo[85367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:01 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.740s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:01 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253 Apr 22 08:55:01 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:01 devstack sudo[85367]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" returned: 0 in 0.683s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:01 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba Apr 22 08:55:01 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:02 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5fc49a0-6342-4b74-90a6-c715040a1253" returned: 0 in 0.706s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-b5fc49a0-6342-4b74-90a6-c715040a1253" released by "delete_volume" :: held 1.514s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['e4bc3efa-e135-4d55-987d-ee518c7f21dd'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:02 devstack cinder-volume[83774]: WARNING cinder.db.sqlalchemy.api [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1418434547'] Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['f1cbf47d-c2b0-4364-b88a-db4690572c40', 'c1c360f4-fd60-4bef-866f-af0c8dd0e318', '40a0fa6e-7546-472a-94c9-41dd012d1dcc', '86cc665a-d5b7-46fe-9de9-c0877e384e6b'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:02 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" returned: 0 in 0.744s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Lock "cinder-quobyte-c6af87a0-dcd9-4cfb-925b-597cf76b8aba" released by "delete_volume" :: held 1.458s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:02 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:02 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Created reservations ['c272e680-80b1-4c69-8570-5799b36f921b', '5c2bb0ff-6c68-4075-adbd-cfd1a9d02eae', 'ad4165c1-eb31-4da2-8ec7-610d2081e1c4', '00a56631-53f0-4472-9757-a03ebb52ff3a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:02 devstack sudo[85385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:02 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Flow 'volume_create_manager' (dc945541-47b1-4816-9a2d-cd0a2c30eb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f992e72-be74-4550-a1d3-6f6eda67858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f992e72-be74-4550-a1d3-6f6eda67858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1229216255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48df214-cd7a-48cd-9144-19500663adba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b8f794344c400bb0b17778e7ac6b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:03Z,use_quota=True,user_id='91c5af404ef74c53b8e0dd66a4ae689e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942b3140-6753-4bc7-bf7c-a9c0dc258bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942b3140-6753-4bc7-bf7c-a9c0dc258bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe895da-d0e7-4966-872d-5c004635c843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe895da-d0e7-4966-872d-5c004635c843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48df214-cd7a-48cd-9144-19500663adba', 'volume_name': 'volume-b48df214-cd7a-48cd-9144-19500663adba', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d564cf-1695-4206-bb06-ee8bd8be1374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d564cf-1695-4206-bb06-ee8bd8be1374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e87505-8b74-4281-8a67-ba2147ea19da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:02 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Volume b48df214-cd7a-48cd-9144-19500663adba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48df214-cd7a-48cd-9144-19500663adba', 'volume_size': 1} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1229216255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48df214-cd7a-48cd-9144-19500663adba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b8f794344c400bb0b17778e7ac6b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:03Z,use_quota=True,user_id='91c5af404ef74c53b8e0dd66a4ae689e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Creating volume b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:02 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:02 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba 1073741824 Apr 22 08:55:02 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:03 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.610s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c93f853b-5d44-4c51-b0f0-93e32ddeb7a8 tempest-GroupSnapshotsTest-1445376737 None] Delete group completed successfully. Apr 22 08:55:03 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.619s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Deleted volume successfully. Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2dbc2c17-5532-4d66-9226-3fddfd250c8a tempest-DeleteServersTestJSON-1357817594 None] Lock "cinder-c6af87a0-dcd9-4cfb-925b-597cf76b8aba-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ed5b8757-533d-4623-ba00-e1ce7147bfd2 tempest-GroupSnapshotsTest-1445376737 None] Group tempest-GroupSnapshotsTest-Group-1419416763: creating Apr 22 08:55:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ed5b8757-533d-4623-ba00-e1ce7147bfd2 tempest-GroupSnapshotsTest-1445376737 None] Group tempest-GroupSnapshotsTest-Group-1419416763: created successfully Apr 22 08:55:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ed5b8757-533d-4623-ba00-e1ce7147bfd2 tempest-GroupSnapshotsTest-1445376737 None] Create group completed successfully. Apr 22 08:55:03 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba 1073741824" returned: 0 in 0.860s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:03 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba Apr 22 08:55:03 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:04 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba" returned: 0 in 0.590s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e87505-8b74-4281-8a67-ba2147ea19da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48df214-cd7a-48cd-9144-19500663adba', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76284fd-514b-40b4-a402-331665cc0d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:04 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Volume volume-b48df214-cd7a-48cd-9144-19500663adba (b48df214-cd7a-48cd-9144-19500663adba): created successfully Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76284fd-514b-40b4-a402-331665cc0d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Flow 'volume_create_manager' (dc945541-47b1-4816-9a2d-cd0a2c30eb16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:04 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a399c05b-dedf-41bd-b021-e4cf6e57f7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Created volume successfully. Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (b38072ab-980f-4ea4-8507-5ad811523e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e24e8b-3728-4987-986f-fbd3f7e87f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Creating offline snapshot 12855f6a-c55e-4f37-879d-ee6aebe0914c of volume b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e24e8b-3728-4987-986f-fbd3f7e87f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1601108088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23932e7-a986-4ae7-bc47-373f26bf04f3,host='devstack@QuobyteHD#QuobyteHD',id=6de494c7-f005-4d99-8550-42131fcbe9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:05Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a305e69-82ac-488f-ba3c-8ec5544fb3dc),volume_type_id=2a305e69-82ac-488f-ba3c-8ec5544fb3dc)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217dff0b-fcbc-4bde-b56b-c20994de153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217dff0b-fcbc-4bde-b56b-c20994de153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994d7478-1dfe-4fc1-9ecc-2b9dc8619c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994d7478-1dfe-4fc1-9ecc-2b9dc8619c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de494c7-f005-4d99-8550-42131fcbe9d3', 'volume_name': 'volume-6de494c7-f005-4d99-8550-42131fcbe9d3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99446b66-7273-4f9f-97c6-0c0d6c18a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99446b66-7273-4f9f-97c6-0c0d6c18a31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a860d00a-0164-4fa7-96d5-aca6821ee968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:05 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Volume 6de494c7-f005-4d99-8550-42131fcbe9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de494c7-f005-4d99-8550-42131fcbe9d3', 'volume_size': 1} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee3285d-e7a1-4e1f-9290-dcbed1c6dd20]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:05 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba Apr 22 08:55:05 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:05 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba" returned: 0 in 0.623s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:05 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c 1G Apr 22 08:55:05 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:06 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c 1G" returned: 0 in 0.624s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48df214-cd7a-48cd-9144-19500663adba -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:06 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48df214-cd7a-48cd-9144-19500663adba -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c Apr 22 08:55:06 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:06 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48df214-cd7a-48cd-9144-19500663adba -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c" returned: 0 in 0.566s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:06 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c is being set with open permissions: ugo+rw Apr 22 08:55:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:06 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c Apr 22 08:55:06 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:07 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c" returned: 0 in 0.535s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:07 devstack sudo[85419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info Apr 22 08:55:07 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:08 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:08 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info is being set with open permissions: ugo+rw Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:08 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info Apr 22 08:55:08 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:08 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.info" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.428s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e23932e7-a986-4ae7-bc47-373f26bf04f3,created_at=2026-04-22T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1601108088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23932e7-a986-4ae7-bc47-373f26bf04f3,host='devstack@QuobyteHD#QuobyteHD',id=6de494c7-f005-4d99-8550-42131fcbe9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:05Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a305e69-82ac-488f-ba3c-8ec5544fb3dc),volume_type_id=2a305e69-82ac-488f-ba3c-8ec5544fb3dc)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Creating volume 6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:08 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:08 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 1073741824 Apr 22 08:55:08 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a8bea397-3d4f-4d30-87e0-2c1a67685731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Create snapshot completed successfully Apr 22 08:55:09 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 1073741824" returned: 0 in 0.608s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:09 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 Apr 22 08:55:09 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "cinder-12855f6a-c55e-4f37-879d-ee6aebe0914c-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-12855f6a-c55e-4f37-879d-ee6aebe0914c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "cinder-quobyte-b48df214-cd7a-48cd-9144-19500663adba" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-quobyte-b48df214-cd7a-48cd-9144-19500663adba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "cinder-quobyte-12855f6a-c55e-4f37-879d-ee6aebe0914c" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-quobyte-12855f6a-c55e-4f37-879d-ee6aebe0914c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Deleting offline snapshot 12855f6a-c55e-4f37-879d-ee6aebe0914c of volume b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] snapshot_file for this snap is: volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec175ae1-a6c8-4b61-9892-177a0626863f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:09 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c Apr 22 08:55:09 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:09 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3" returned: 0 in 0.730s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a860d00a-0164-4fa7-96d5-aca6821ee968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de494c7-f005-4d99-8550-42131fcbe9d3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f717294-4f2b-456e-a346-1d4f1ba971ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:09 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Volume volume-6de494c7-f005-4d99-8550-42131fcbe9d3 (6de494c7-f005-4d99-8550-42131fcbe9d3): created successfully Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f717294-4f2b-456e-a346-1d4f1ba971ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (b38072ab-980f-4ea4-8507-5ad811523e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f9539901-760b-4dce-8154-83019c639835 tempest-GroupSnapshotsTest-1445376737 None] Created volume successfully. Apr 22 08:55:10 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c" returned: 0 in 0.601s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48df214-cd7a-48cd-9144-19500663adba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e093f5d8-191a-431c-a981-cfc38741367d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:10 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba Apr 22 08:55:10 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (e300b37c-33ae-4387-b623-0c943501241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ecd388-81c0-48a7-b94e-e49238b6de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ecd388-81c0-48a7-b94e-e49238b6de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-832931457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23932e7-a986-4ae7-bc47-373f26bf04f3,host='devstack@QuobyteHD#QuobyteHD',id=2284eb6f-b8df-4597-b94f-879948bed08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:11Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a305e69-82ac-488f-ba3c-8ec5544fb3dc),volume_type_id=2a305e69-82ac-488f-ba3c-8ec5544fb3dc)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c394a55-658c-4859-913e-4a55fc7b6266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c394a55-658c-4859-913e-4a55fc7b6266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27a4b9b-ca75-4178-ba0f-6c944a78783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27a4b9b-ca75-4178-ba0f-6c944a78783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2284eb6f-b8df-4597-b94f-879948bed08f', 'volume_name': 'volume-2284eb6f-b8df-4597-b94f-879948bed08f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc71dba1-a3b5-4faf-ab1b-a702f6e989a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc71dba1-a3b5-4faf-ab1b-a702f6e989a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59954429-b56d-44fd-ab8b-24fe08fb4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:10 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Volume 2284eb6f-b8df-4597-b94f-879948bed08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2284eb6f-b8df-4597-b94f-879948bed08f', 'volume_size': 1} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e23932e7-a986-4ae7-bc47-373f26bf04f3,created_at=2026-04-22T06:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-832931457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e23932e7-a986-4ae7-bc47-373f26bf04f3,host='devstack@QuobyteHD#QuobyteHD',id=2284eb6f-b8df-4597-b94f-879948bed08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:11Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a305e69-82ac-488f-ba3c-8ec5544fb3dc),volume_type_id=2a305e69-82ac-488f-ba3c-8ec5544fb3dc)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Creating volume 2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:10 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:10 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f 1073741824 Apr 22 08:55:10 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:11 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba" returned: 0 in 0.677s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:11 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c Apr 22 08:55:11 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:11 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f 1073741824" returned: 0 in 0.642s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:11 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f Apr 22 08:55:11 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:11 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c" returned: 0 in 0.570s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:11 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c Apr 22 08:55:11 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:12 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59954429-b56d-44fd-ab8b-24fe08fb4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2284eb6f-b8df-4597-b94f-879948bed08f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775ccf4e-cdc2-4f9c-861f-29a5167d6722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:12 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Volume volume-2284eb6f-b8df-4597-b94f-879948bed08f (2284eb6f-b8df-4597-b94f-879948bed08f): created successfully Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775ccf4e-cdc2-4f9c-861f-29a5167d6722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (e300b37c-33ae-4387-b623-0c943501241f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-66ac8829-9ab5-4df3-a073-5c31854086e7 tempest-GroupSnapshotsTest-1445376737 None] Created volume successfully. Apr 22 08:55:12 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba.12855f6a-c55e-4f37-879d-ee6aebe0914c" returned: 0 in 0.554s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-quobyte-12855f6a-c55e-4f37-879d-ee6aebe0914c" released by "_delete_snapshot" :: held 2.481s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-quobyte-b48df214-cd7a-48cd-9144-19500663adba" released by "delete_snapshot" :: held 2.499s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:12 devstack cinder-volume[83774]: WARNING cinder.quota [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Created reservations ['ea2a0393-1c98-4a93-9ae9-c822f13ab4f2', '2f1dfa9c-3031-47ab-96f3-237aacbaf1da', '37fbebb5-c369-4b1d-a980-093f3bd006d3', '5ac80f4c-c9bf-40b5-93a2-d26611496171'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Delete snapshot completed successfully. Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-841c045d-b307-4339-bfaf-46cd32de7f5f tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-12855f6a-c55e-4f37-879d-ee6aebe0914c-delete_snapshot" released by "delete_snapshot" :: held 2.593s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:12 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:12 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "cinder-b48df214-cd7a-48cd-9144-19500663adba-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-b48df214-cd7a-48cd-9144-19500663adba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "cinder-quobyte-b48df214-cd7a-48cd-9144-19500663adba" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-quobyte-b48df214-cd7a-48cd-9144-19500663adba" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:13 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3f162-5843-474e-b86a-c4981c5082d9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:13 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba Apr 22 08:55:13 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:13 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2af1e536-8d4c-487a-8715-e56a578a0d3f tempest-GroupSnapshotsTest-1445376737 None] Update group completed successfully. Apr 22 08:55:13 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.664s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:13 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba" returned: 0 in 0.807s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:13 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba Apr 22 08:55:13 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:14 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b48df214-cd7a-48cd-9144-19500663adba" returned: 0 in 0.575s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-quobyte-b48df214-cd7a-48cd-9144-19500663adba" released by "delete_volume" :: held 1.458s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:14 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5f31eeca-37c4-4242-8bd0-0a8114fc4c27 tempest-GroupSnapshotsTest-1445376737 None] Update group completed successfully. Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Created reservations ['57b34a45-6e20-4082-8e0e-9448b369978f', '62aa7d7b-16cd-4e94-90b4-b2477ec29bad', 'c228a21c-d4fd-432e-b2ba-e27c35d71796', 'df811865-aa79-46f7-8b5b-24f127cb7aad'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:14 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:14 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:15 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.544s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:15 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Deleted volume successfully. Apr 22 08:55:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d1016843-d7d7-4ab4-b3a4-2f0558b8aaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1387641521 None] Lock "cinder-b48df214-cd7a-48cd-9144-19500663adba-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9f2ca35b-e1f4-46f8-88b8-7cf0ebad8174 tempest-GroupSnapshotsTest-1445376737 None] Update group completed successfully. Apr 22 08:55:16 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-52210d9b-fbc7-409f-84d9-1bf79bf2cd88 tempest-GroupSnapshotsTest-1445376737 None] Update group completed successfully. Apr 22 08:55:18 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] GroupSnapshot 21b752f1-515c-4820-a2ab-b16afc93d450: creating. Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Group snapshot 21b752f1-515c-4820-a2ab-b16afc93d450: creating. {{(pid=83774) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Creating offline snapshot 0878363e-169a-4e29-8fd7-dd07bd663d88 of volume 6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[631b7fe9-64ac-4593-96ba-6f0d02d5f4b5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:18 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 Apr 22 08:55:18 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:18 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3" returned: 0 in 0.705s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:18 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 1G Apr 22 08:55:18 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:19 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 1G" returned: 0 in 0.764s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de494c7-f005-4d99-8550-42131fcbe9d3 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:19 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de494c7-f005-4d99-8550-42131fcbe9d3 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 Apr 22 08:55:19 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:20 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de494c7-f005-4d99-8550-42131fcbe9d3 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88" returned: 0 in 0.675s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:20 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:55:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:20 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 Apr 22 08:55:20 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:20 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88" returned: 0 in 0.540s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:21 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info Apr 22 08:55:21 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:21 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info" returned: 0 in 0.594s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:21 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:55:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:21 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info Apr 22 08:55:21 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:22 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.info" returned: 0 in 0.584s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Creating offline snapshot 99c8cd44-766e-4cee-992d-6c845730902a of volume 2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2286d35e-ccfa-4564-b9da-4fce4738afa5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:22 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f Apr 22 08:55:22 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:22 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Flow 'volume_create_manager' (3201e8c7-1cf5-451f-b71e-037445d3940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bba5cea-5ab7-4ef2-a9f0-4e3b47b47e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bba5cea-5ab7-4ef2-a9f0-4e3b47b47e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1402720506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8091102dbc24ab9b749f02e135d83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:23Z,use_quota=True,user_id='fd4ab0b535bb48a8bad39d726742f754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0940b588-97ba-45b4-80dc-5af711d19dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0940b588-97ba-45b4-80dc-5af711d19dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2621b8-cf00-4307-93fa-640334d590b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG cinder.image.glance [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Creating Keystone auth plugin from conf {{(pid=83774) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f" returned: 0 in 0.775s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:23 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a 1G Apr 22 08:55:23 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2621b8-cf00-4307-93fa-640334d590b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b', 'volume_name': 'volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04c8e8c-90c1-4212-883f-97ea626f59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04c8e8c-90c1-4212-883f-97ea626f59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3346e873-cf4a-4209-af84-52283cc68b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:23 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Volume 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Trying to clone 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b from image 403fb852-3ee8-4a92-abbf-1734c0db4994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]). {{(pid=83774) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 08:55:23 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Image download 20.69 MB at 20.69 MB/s Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa85745-0690-40a2-bd9b-2c063941fdc9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:23 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a 1G" returned: 0 in 0.683s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2284eb6f-b8df-4597-b94f-879948bed08f -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:23 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD Apr 22 08:55:23 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:23 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2284eb6f-b8df-4597-b94f-879948bed08f -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a Apr 22 08:55:23 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:24 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2284eb6f-b8df-4597-b94f-879948bed08f -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a" returned: 0 in 0.577s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:24 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:24 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a Apr 22 08:55:24 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:24 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 is fetched for user fd4ab0b535bb48a8bad39d726742f754. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[80636af5-361e-41fb-b986-01addcdeda4b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:24 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD Apr 22 08:55:24 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:24 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:24 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info Apr 22 08:55:24 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:24 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:25 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:25 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:25 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info Apr 22 08:55:25 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:25 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.info" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.575s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1402720506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8091102dbc24ab9b749f02e135d83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:23Z,use_quota=True,user_id='fd4ab0b535bb48a8bad39d726742f754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Creating volume 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:25 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:25 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=115,cinder:UPDATE=105,cinder:DELETE=11,cinder:INSERT=24 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:55:25 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b 1073741824 Apr 22 08:55:25 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:25 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f686101f-75f7-4efb-ab62-f41dc6355a2d tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 21b752f1-515c-4820-a2ab-b16afc93d450: created successfully Apr 22 08:55:26 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 21b752f1-515c-4820-a2ab-b16afc93d450: deleting Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 21b752f1-515c-4820-a2ab-b16afc93d450: deleting {{(pid=83774) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-6de494c7-f005-4d99-8550-42131fcbe9d3" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:26 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b 1073741824" returned: 0 in 0.944s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-6de494c7-f005-4d99-8550-42131fcbe9d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-0878363e-169a-4e29-8fd7-dd07bd663d88" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-0878363e-169a-4e29-8fd7-dd07bd663d88" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Deleting offline snapshot 0878363e-169a-4e29-8fd7-dd07bd663d88 of volume 6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] snapshot_file for this snap is: volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:55:26 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b71801-d051-4424-8fb6-504e47b3b1c5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:26 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:26 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 Apr 22 08:55:26 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:27 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88" returned: 0 in 0.911s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de494c7-f005-4d99-8550-42131fcbe9d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[595cf9d4-5b48-4bb6-8827-f97fe51165b2]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:27 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 0 in 1.025s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Attempting download of 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f764011-7a09-42ba-8798-d6e83a709f61]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:27 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 Apr 22 08:55:27 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:28 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju Apr 22 08:55:28 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:28 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju" returned: 0 in 0.674s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:28 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju Apr 22 08:55:28 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:28 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3" returned: 0 in 0.924s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:28 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 Apr 22 08:55:28 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:29 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju" returned: 1 in 0.851s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_mv58stju' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:55:29 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b5bf3-936a-4001-9057-d46fe7f304c7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:29 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD Apr 22 08:55:29 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:29 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88" returned: 0 in 0.847s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:29 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88 Apr 22 08:55:29 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:30 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3.0878363e-169a-4e29-8fd7-dd07bd663d88" returned: 0 in 0.565s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-0878363e-169a-4e29-8fd7-dd07bd663d88" released by "_delete_snapshot" :: held 3.357s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-6de494c7-f005-4d99-8550-42131fcbe9d3" released by "delete_snapshot" :: held 3.387s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-2284eb6f-b8df-4597-b94f-879948bed08f" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2284eb6f-b8df-4597-b94f-879948bed08f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-99c8cd44-766e-4cee-992d-6c845730902a" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-99c8cd44-766e-4cee-992d-6c845730902a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Deleting offline snapshot 99c8cd44-766e-4cee-992d-6c845730902a of volume 2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:55:30 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] snapshot_file for this snap is: volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] 403fb852-3ee8-4a92-abbf-1734c0db4994 was qcow2, converting to raw {{(pid=83774) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2aef1-609f-4c4d-8c06-229366420368]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:30 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:30 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:30 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a Apr 22 08:55:30 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:31 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a" returned: 0 in 1.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2284eb6f-b8df-4597-b94f-879948bed08f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:55:31 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3398e4-fb6a-4305-ae88-1ebe717676c7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:31 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f Apr 22 08:55:31 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:32 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f" returned: 0 in 0.742s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:32 devstack sudo[86092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a Apr 22 08:55:32 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:33 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 0 in 3.280s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:33 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994__zia8jrddevstack@QuobyteHD, size 112.00 MB, duration 3.28 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:55:33 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Converted 112.00 MB image at 34.12 MB/s Apr 22 08:55:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:33 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b 1G Apr 22 08:55:33 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:34 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a" returned: 0 in 1.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:34 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a Apr 22 08:55:34 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:34 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b 1G" returned: 0 in 0.827s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea433a3-395c-4aa2-9451-551ab41bfba4]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:34 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:34 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:34 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f.99c8cd44-766e-4cee-992d-6c845730902a" returned: 0 in 0.626s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-99c8cd44-766e-4cee-992d-6c845730902a" released by "_delete_snapshot" :: held 4.549s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2284eb6f-b8df-4597-b94f-879948bed08f" released by "delete_snapshot" :: held 4.564s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=120,cinder:SELECT=115,cinder:INSERT=28,cinder:DELETE=3 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:55:34 devstack cinder-volume[83774]: WARNING cinder.quota [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1894700731 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1894700731, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:55:34 devstack cinder-volume[83774]: WARNING cinder.quota [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1894700731 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1894700731, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:55:34 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['89f0606a-eb2b-49e0-87de-850c8cf0d46c', '5916e5bf-bbf5-418c-9029-278d7eeb2294', '85c90aae-dad7-4b67-8ccd-3de6760f72a5', '2ef7fde4-5cc1-4669-90f8-28d4f2c2b221'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:35 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['334c4f52-87ae-4bc4-9a44-8e9d6f133f45', '8cf8b490-7996-44bc-a101-44b900dbef91', 'a3d31655-cb48-44fd-8320-9c6f8d8d47a1', 'e658dfaf-284c-4cda-ab06-31e7421ed625'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7f61a4e5-6f0a-49bf-af0d-3d823f3425e7 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 21b752f1-515c-4820-a2ab-b16afc93d450: deleted successfully Apr 22 08:55:35 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 0 in 0.827s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:35 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:35 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:36 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 1 in 0.928s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Downloaded image 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b successfully. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 for user fd4ab0b535bb48a8bad39d726742f754 is deleted. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Marking volume 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b as bootable. {{(pid=83774) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Copying metadata from image 403fb852-3ee8-4a92-abbf-1734c0db4994 to 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b. {{(pid=83774) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Creating volume glance metadata for volume 5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b backed by image 403fb852-3ee8-4a92-abbf-1734c0db4994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83774) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-2284eb6f-b8df-4597-b94f-879948bed08f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2284eb6f-b8df-4597-b94f-879948bed08f" acquired by "delete_volume" :: waited 0.024s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3346e873-cf4a-4209-af84-52283cc68b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a736a430-0cc2-4d65-901b-50bb315af826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cd59c4-ddf9-4516-ba26-4ffd54113835]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:36 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Volume volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b (5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b): created successfully Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a736a430-0cc2-4d65-901b-50bb315af826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Flow 'volume_create_manager' (3201e8c7-1cf5-451f-b71e-037445d3940b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6285f460-cc44-49af-a736-51bcd3eceb14 tempest-VolumesImageMetadata-605133868 None] Created volume successfully. Apr 22 08:55:36 devstack sudo[86122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f Apr 22 08:55:36 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:37 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f" returned: 0 in 0.961s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:37 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f Apr 22 08:55:37 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Acquiring lock "cinder-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Lock "cinder-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Acquiring lock "cinder-quobyte-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Lock "cinder-quobyte-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" acquired by "delete_volume" :: waited 0.029s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:38 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2284eb6f-b8df-4597-b94f-879948bed08f" returned: 0 in 0.646s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdfb4d5-2e54-4fc2-8f33-8f0e5eb302ff]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-2284eb6f-b8df-4597-b94f-879948bed08f" released by "delete_volume" :: held 1.798s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-6de494c7-f005-4d99-8550-42131fcbe9d3" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-6de494c7-f005-4d99-8550-42131fcbe9d3" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:38 devstack sudo[86140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:38 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[75608988-3499-4935-a6ed-cf18a4ab5604]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:38 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 Apr 22 08:55:38 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:39 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3" returned: 0 in 0.973s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:39 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3 Apr 22 08:55:39 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:39 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 0 in 1.257s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:39 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:39 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:40 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6de494c7-f005-4d99-8550-42131fcbe9d3" returned: 0 in 1.076s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-6de494c7-f005-4d99-8550-42131fcbe9d3" released by "delete_volume" :: held 2.242s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['0f0087cb-5c3a-4fbf-b147-71a998ce1973'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:40 devstack cinder-volume[83774]: WARNING cinder.quota [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1894700731 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1894700731, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['ffee8e70-3914-446a-9ad3-59c6aea139d6', '16e367af-d26b-4c05-af3f-07a565b3b079', '4909c284-1b22-4c5c-b9e4-eeae68b3499a', 'd25f0ebc-e983-4df2-9738-a01f3d740b52'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['0ed76c47-54a6-4822-90c3-fa19c7cb3ef6', '16cfac2c-d876-4de3-b49a-ad3c9d11e5fc', 'c9e457b3-83f2-4a46-9328-7289a0de1753', '680992a9-6851-439f-a56b-0092c12061ad'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:40 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:40 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:41 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 1 in 1.781s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:55:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:41 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b Apr 22 08:55:41 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6781e1f4-a7ed-4dd2-8792-c9538a1a6d3a tempest-GroupSnapshotsTest-1445376737 None] Group tempest-GroupSnapshotsTest-Group-1773321142: creating Apr 22 08:55:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6781e1f4-a7ed-4dd2-8792-c9538a1a6d3a tempest-GroupSnapshotsTest-1445376737 None] Group tempest-GroupSnapshotsTest-Group-1773321142: created successfully Apr 22 08:55:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6781e1f4-a7ed-4dd2-8792-c9538a1a6d3a tempest-GroupSnapshotsTest-1445376737 None] Create group completed successfully. Apr 22 08:55:41 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.154s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:41 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-308a4430-e7b1-469f-8b28-789356df2ac2 tempest-GroupSnapshotsTest-1445376737 None] Delete group completed successfully. Apr 22 08:55:42 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" returned: 0 in 0.916s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Lock "cinder-quobyte-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b" released by "delete_volume" :: held 4.137s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Created reservations ['5982a7fa-2e59-4390-b957-72768359f507', '707d3376-fe6f-4c73-907f-096d7320be82', '2b26d5f8-db00-473c-9c1a-f21eecae4a25', 'f03f37fb-a2c5-49d8-bce2-6f4abf4a64be'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:42 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:42 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:42 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.781s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:42 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Deleted volume successfully. Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8dfc697-2002-434e-b2cf-db8183e65b8b tempest-VolumesImageMetadata-605133868 None] Lock "cinder-5795ecfc-3ece-4c77-b4da-b0bf32b8ab8b-delete_volume" released by "delete_volume" :: held 5.089s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (fbbed66f-b133-45d7-a7a5-24b66101d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f311736c-7639-4695-abcb-0e0b190e69b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f311736c-7639-4695-abcb-0e0b190e69b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-635429736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53d97c08-548e-44cd-86f3-34b2614e1ca5,host='devstack@QuobyteHD#QuobyteHD',id=27a944d4-321b-49a6-bd11-ac0655efe833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:44Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a186d3ec-c8bd-4f6a-92ec-05f2fcfd6a78),volume_type_id=a186d3ec-c8bd-4f6a-92ec-05f2fcfd6a78)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d881bf9b-d6a2-4459-9c09-dfc295c68948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d881bf9b-d6a2-4459-9c09-dfc295c68948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2a6d92-0015-4507-8244-ff59e8da9776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2a6d92-0015-4507-8244-ff59e8da9776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a944d4-321b-49a6-bd11-ac0655efe833', 'volume_name': 'volume-27a944d4-321b-49a6-bd11-ac0655efe833', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c640d7bf-c381-4fc4-adb0-bd084ba774b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c640d7bf-c381-4fc4-adb0-bd084ba774b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220ce323-ca6d-4496-9158-1914d48e185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Volume 27a944d4-321b-49a6-bd11-ac0655efe833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a944d4-321b-49a6-bd11-ac0655efe833', 'volume_size': 1} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53d97c08-548e-44cd-86f3-34b2614e1ca5,created_at=2026-04-22T06:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-635429736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53d97c08-548e-44cd-86f3-34b2614e1ca5,host='devstack@QuobyteHD#QuobyteHD',id=27a944d4-321b-49a6-bd11-ac0655efe833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392e766695a47c1b6e2789f26f4e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:44Z,use_quota=True,user_id='90493e4f53ca44be8a61e814e89187d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a186d3ec-c8bd-4f6a-92ec-05f2fcfd6a78),volume_type_id=a186d3ec-c8bd-4f6a-92ec-05f2fcfd6a78)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Creating volume 27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:43 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:43 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 1073741824 Apr 22 08:55:43 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:44 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 1073741824" returned: 0 in 1.083s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:45 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 Apr 22 08:55:45 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:45 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833" returned: 0 in 0.802s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220ce323-ca6d-4496-9158-1914d48e185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a944d4-321b-49a6-bd11-ac0655efe833', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01543788-14c5-47d0-a619-4f1708537a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:45 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Volume volume-27a944d4-321b-49a6-bd11-ac0655efe833 (27a944d4-321b-49a6-bd11-ac0655efe833): created successfully Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01543788-14c5-47d0-a619-4f1708537a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Flow 'volume_create_manager' (fbbed66f-b133-45d7-a7a5-24b66101d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d2d074b5-7129-4dd2-b396-738b6e718be9 tempest-GroupSnapshotsTest-1445376737 None] Created volume successfully. Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Flow 'volume_create_manager' (9bc0d5db-f6c2-413d-b95c-4c126cf10f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fc6897-a529-44b2-83cf-0a7b660fa408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fc6897-a529-44b2-83cf-0a7b660fa408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-861142717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a360c6c9-8101-48a5-89d5-4fb77d5172cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e4ecc5b5f0a4db589da53e07e270d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:47Z,use_quota=True,user_id='30c3c2c7f87546c98c95abcc4afa2d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cb5eee-f69e-4cb6-9b75-7c63bbeeacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cb5eee-f69e-4cb6-9b75-7c63bbeeacc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b800a0-449c-4188-8d4f-d02b757c69c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b800a0-449c-4188-8d4f-d02b757c69c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a360c6c9-8101-48a5-89d5-4fb77d5172cf', 'volume_name': 'volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b6008-2540-4ead-8a0d-e2832445fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b6008-2540-4ead-8a0d-e2832445fe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1638157e-38e9-4647-b861-ba3448e79825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:46 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Volume a360c6c9-8101-48a5-89d5-4fb77d5172cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf', 'volume_size': 1} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-861142717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a360c6c9-8101-48a5-89d5-4fb77d5172cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e4ecc5b5f0a4db589da53e07e270d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:47Z,use_quota=True,user_id='30c3c2c7f87546c98c95abcc4afa2d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Creating volume a360c6c9-8101-48a5-89d5-4fb77d5172cf {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:46 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:46 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf 1073741824 Apr 22 08:55:46 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:47 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] GroupSnapshot 2be23f6d-3746-4201-8e2c-dc454929bcc7: creating. Apr 22 08:55:47 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Group snapshot 2be23f6d-3746-4201-8e2c-dc454929bcc7: creating. {{(pid=83774) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 08:55:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:48 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf 1073741824" returned: 0 in 1.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:48 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf Apr 22 08:55:48 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:49 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf" returned: 0 in 0.834s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.239s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1638157e-38e9-4647-b861-ba3448e79825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e221003-5765-44b9-8450-e6d400195377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Creating offline snapshot 5ee4347e-7b7d-4073-8f51-f98c70668713 of volume 27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:55:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Volume volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf (a360c6c9-8101-48a5-89d5-4fb77d5172cf): created successfully Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e221003-5765-44b9-8450-e6d400195377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Flow 'volume_create_manager' (9bc0d5db-f6c2-413d-b95c-4c126cf10f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:49 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f9183229-cc9b-44a7-a172-905fe041cd1b tempest-AbsoluteLimitsTests-2087288656 None] Created volume successfully. Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b4552-d7aa-41b2-9384-169af3a257c8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:49 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 Apr 22 08:55:49 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:50 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833" returned: 0 in 0.890s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:50 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 1G Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:50 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Flow 'volume_create_manager' (c2b6f4ae-1097-42a1-b85b-55e1dea0c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87b0a1-e5d1-43dd-8926-2b3bc0ebdbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87b0a1-e5d1-43dd-8926-2b3bc0ebdbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2033959923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8826d3-c8fc-41c7-b227-8f09bac90b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd557ebc0cc445f9afed7530d53b554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:50Z,use_quota=True,user_id='25177756e96a4ac49ca92202a0f6ce69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df8f2b-ffb1-4571-9b66-974c373ba5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df8f2b-ffb1-4571-9b66-974c373ba5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6092db05-69ab-4986-aa0d-6acf5ab9d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6092db05-69ab-4986-aa0d-6acf5ab9d0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8826d3-c8fc-41c7-b227-8f09bac90b9b', 'volume_name': 'volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f225f3-4e60-406c-a8cb-1aa27df6dfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f225f3-4e60-406c-a8cb-1aa27df6dfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51073fbf-961b-4ac5-ad8a-f171e8cd6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Volume 7c8826d3-c8fc-41c7-b227-8f09bac90b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b', 'volume_size': 1} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Acquiring lock "cinder-a360c6c9-8101-48a5-89d5-4fb77d5172cf-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Lock "cinder-a360c6c9-8101-48a5-89d5-4fb77d5172cf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Acquiring lock "cinder-quobyte-a360c6c9-8101-48a5-89d5-4fb77d5172cf" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Lock "cinder-quobyte-a360c6c9-8101-48a5-89d5-4fb77d5172cf" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[327692e1-fad8-486c-bb82-5d9547ee73d9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:50 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf Apr 22 08:55:50 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:51 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf" returned: 0 in 0.727s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:51 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf Apr 22 08:55:51 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:51 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 1G" returned: 0 in 1.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a944d4-321b-49a6-bd11-ac0655efe833 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:51 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a944d4-321b-49a6-bd11-ac0655efe833 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 Apr 22 08:55:51 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:51 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a360c6c9-8101-48a5-89d5-4fb77d5172cf" returned: 0 in 0.517s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Lock "cinder-quobyte-a360c6c9-8101-48a5-89d5-4fb77d5172cf" released by "delete_volume" :: held 1.338s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Created reservations ['c4952046-151d-46d6-96da-bf4e5874d82e', '41243af4-04b5-4736-8d9c-50e0e7a05747', '4b6b4683-500b-422b-b6ff-0ff0d12d3ba4', 'c98ef723-e7a4-448e-9a8b-f8cb7cb60fe9'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:51 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:55:51 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:52 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a944d4-321b-49a6-bd11-ac0655efe833 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713" returned: 0 in 0.834s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:52 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:52 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 Apr 22 08:55:52 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:52 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.712s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:55:52 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Deleted volume successfully. Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa599c2d-5460-42b3-913e-34c05ff4f8f2 tempest-AbsoluteLimitsTests-2087288656 None] Lock "cinder-a360c6c9-8101-48a5-89d5-4fb77d5172cf-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:55:52 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713" returned: 0 in 0.490s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:52 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info Apr 22 08:55:52 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:53 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info" returned: 0 in 0.650s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:53 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:55:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:53 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info Apr 22 08:55:53 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:54 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.info" returned: 0 in 0.895s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.415s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.232s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2033959923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8826d3-c8fc-41c7-b227-8f09bac90b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd557ebc0cc445f9afed7530d53b554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:50Z,use_quota=True,user_id='25177756e96a4ac49ca92202a0f6ce69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Creating volume 7c8826d3-c8fc-41c7-b227-8f09bac90b9b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:54 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:54 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b 1073741824 Apr 22 08:55:54 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0de5b26d-a97c-453f-9751-6f00f7893950 tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 2be23f6d-3746-4201-8e2c-dc454929bcc7: created successfully Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Flow 'volume_create_manager' (e54d8e15-e810-4aa8-9e8b-557bdb767c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027483fc-4fec-4be2-a004-c4e0c7bb99f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 2be23f6d-3746-4201-8e2c-dc454929bcc7: deleting Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 2be23f6d-3746-4201-8e2c-dc454929bcc7: deleting {{(pid=83774) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-27a944d4-321b-49a6-bd11-ac0655efe833" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027483fc-4fec-4be2-a004-c4e0c7bb99f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:55Z,deleted=False,deleted_at=None,display_description='',display_name='17821f1e-f87d-49b5-ba04-d4f9485880fd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a31314-5885-4b0e-9b56-34990af650db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727c694b7674bd9801cf63a4cc9cc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:55Z,use_quota=True,user_id='c145b4bfb33e471f8c574fb5bc0527c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3278868e-8969-465c-87f1-f882e20bb90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3278868e-8969-465c-87f1-f882e20bb90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5564ce17-d58b-4a44-a05f-10c15ee1c00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5564ce17-d58b-4a44-a05f-10c15ee1c00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a31314-5885-4b0e-9b56-34990af650db', 'volume_name': 'volume-f7a31314-5885-4b0e-9b56-34990af650db', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395d04d4-9ef7-46cf-ab32-94bf84fa6538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395d04d4-9ef7-46cf-ab32-94bf84fa6538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66a7692-c798-4027-a498-90df396647db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:55 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Volume f7a31314-5885-4b0e-9b56-34990af650db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a31314-5885-4b0e-9b56-34990af650db', 'volume_size': 1} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-27a944d4-321b-49a6-bd11-ac0655efe833" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-5ee4347e-7b7d-4073-8f51-f98c70668713" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-5ee4347e-7b7d-4073-8f51-f98c70668713" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Deleting offline snapshot 5ee4347e-7b7d-4073-8f51-f98c70668713 of volume 27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:55:55 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] snapshot_file for this snap is: volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b 1073741824" returned: 0 in 1.245s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29a5c0-d1d2-45d3-8c0c-a49432fb7720]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:55 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b Apr 22 08:55:55 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:56 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 Apr 22 08:55:56 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:56 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713" returned: 0 in 0.979s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27a944d4-321b-49a6-bd11-ac0655efe833(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c9e53-2dc3-42c8-8436-2d58044e6600]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:56 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b" returned: 0 in 1.028s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:55:55Z,deleted=False,deleted_at=None,display_description='',display_name='17821f1e-f87d-49b5-ba04-d4f9485880fd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a31314-5885-4b0e-9b56-34990af650db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727c694b7674bd9801cf63a4cc9cc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:55:55Z,use_quota=True,user_id='c145b4bfb33e471f8c574fb5bc0527c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Creating volume f7a31314-5885-4b0e-9b56-34990af650db {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:55:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:55:57 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:57 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db 1073741824 Apr 22 08:55:57 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51073fbf-961b-4ac5-ad8a-f171e8cd6f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fa7960-3687-4983-8df4-fb7797ddb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:57 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 Apr 22 08:55:57 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:57 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Volume volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b (7c8826d3-c8fc-41c7-b227-8f09bac90b9b): created successfully Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fa7960-3687-4983-8df4-fb7797ddb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Flow 'volume_create_manager' (c2b6f4ae-1097-42a1-b85b-55e1dea0c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7cc8eab2-05fe-4340-93da-9f36994976a6 tempest-ServerRescueNegativeTestJSON-133798928 None] Created volume successfully. Apr 22 08:55:58 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833" returned: 0 in 1.124s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:58 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 Apr 22 08:55:58 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:58 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db 1073741824" returned: 0 in 1.408s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:58 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db Apr 22 08:55:58 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:59 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713" returned: 0 in 1.406s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:55:59 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713 Apr 22 08:55:59 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:55:59 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db" returned: 0 in 1.100s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] <== create_volume: return (2630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.632s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66a7692-c798-4027-a498-90df396647db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a31314-5885-4b0e-9b56-34990af650db', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9749fff1-0e41-4b7d-9eeb-538aa5209e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:55:59 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Volume volume-f7a31314-5885-4b0e-9b56-34990af650db (f7a31314-5885-4b0e-9b56-34990af650db): created successfully Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9749fff1-0e41-4b7d-9eeb-538aa5209e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:55:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Flow 'volume_create_manager' (e54d8e15-e810-4aa8-9e8b-557bdb767c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:55:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-4beeda5a-5f97-4ab5-84e5-c8a11edf9628 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Created volume successfully. Apr 22 08:56:00 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833.5ee4347e-7b7d-4073-8f51-f98c70668713" returned: 0 in 0.944s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-5ee4347e-7b7d-4073-8f51-f98c70668713" released by "_delete_snapshot" :: held 4.693s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-27a944d4-321b-49a6-bd11-ac0655efe833" released by "delete_snapshot" :: held 4.705s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:00 devstack cinder-volume[83774]: WARNING cinder.quota [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-785612960 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-785612960, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:56:00 devstack cinder-volume[83774]: WARNING cinder.quota [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-785612960 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-785612960, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:56:00 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['9e0c5a95-6824-48da-b8b4-29af5ae170b0', 'f7e61bb6-61c8-45f3-8e61-aaebb94392bd', 'bf2d83dd-80d8-4b17-a95f-bc9f55d3dc29', 'ff130843-a4c6-4b02-b64f-5b1969f3267c'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:00 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a7935d77-4748-46d1-97d2-002153483ecc tempest-GroupSnapshotsTest-1445376737 None] group_snapshot 2be23f6d-3746-4201-8e2c-dc454929bcc7: deleted successfully Apr 22 08:56:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "cinder-quobyte-27a944d4-321b-49a6-bd11-ac0655efe833" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-27a944d4-321b-49a6-bd11-ac0655efe833" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:01 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01c678-538e-4aee-bee5-1796e3d85731]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:01 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 Apr 22 08:56:01 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:02 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833" returned: 0 in 0.853s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:02 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833 Apr 22 08:56:02 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:02 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d30fea-0fc2-4394-a834-543054fe127f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:02 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db Apr 22 08:56:02 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:03 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-27a944d4-321b-49a6-bd11-ac0655efe833" returned: 0 in 1.097s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Lock "cinder-quobyte-27a944d4-321b-49a6-bd11-ac0655efe833" released by "delete_volume" :: held 2.126s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:03 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['20683f51-7387-48fe-b315-1b4ee4980837'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:03 devstack cinder-volume[83774]: WARNING cinder.quota [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-785612960 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-785612960, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:56:03 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Created reservations ['215ad4df-3214-4f8c-a77f-e0852c11853c', '0f0cfa72-6c23-4168-92cc-6a99cfedc72c', 'b5529ec1-b743-4c2c-ad05-5c82f6b833aa', '8bc3e3de-049c-4aa1-a715-8daa1a2cbba4'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:04 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:04 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:04 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db" returned: 0 in 1.721s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.790s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4', 'name': 'volume-f7a31314-5885-4b0e-9b56-34990af650db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce6234ff-b137-4937-a7f4-c0fde2518151', 'enforce_multipath': True} {{(pid=83774) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 22 08:56:04 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-51446620-db2a-4e1a-8d78-de27542b38dc req-f9e276ef-13dd-4994-b155-a396e2e53f89 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] attachment_update completed successfully. Apr 22 08:56:05 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.029s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:05 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-78ce5e40-c342-42fd-b594-d128c7fe762e tempest-GroupSnapshotsTest-1445376737 None] Delete group completed successfully. Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Flow 'volume_create_manager' (0b33afe0-749f-40b3-918c-a3370ec3b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e4e081-a820-4289-983a-27184d500d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e4e081-a820-4289-983a-27184d500d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2119689764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207a7992-197f-4195-90e5-5e0bbf629cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ddb7be7f28400fb4d44bfd762142ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:13Z,use_quota=True,user_id='c290cdf196b948be91ea777942ad2435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721afdf2-6ef3-479c-948e-a8b52aee7813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721afdf2-6ef3-479c-948e-a8b52aee7813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e2f39e-0078-493d-accd-d40b05fba8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e2f39e-0078-493d-accd-d40b05fba8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207a7992-197f-4195-90e5-5e0bbf629cd7', 'volume_name': 'volume-207a7992-197f-4195-90e5-5e0bbf629cd7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b41824-b2cf-4f09-9f62-e92b20b31ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b41824-b2cf-4f09-9f62-e92b20b31ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772b5a63-e9ca-4106-90a8-3c4cda26604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:12 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Volume 207a7992-197f-4195-90e5-5e0bbf629cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207a7992-197f-4195-90e5-5e0bbf629cd7', 'volume_size': 1} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2119689764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207a7992-197f-4195-90e5-5e0bbf629cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ddb7be7f28400fb4d44bfd762142ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:13Z,use_quota=True,user_id='c290cdf196b948be91ea777942ad2435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Creating volume 207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:56:12 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:12 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 1073741824 Apr 22 08:56:12 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:12 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:12 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:13 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.123s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:14 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 1073741824" returned: 0 in 1.771s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:14 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:56:14 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:15 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.586s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772b5a63-e9ca-4106-90a8-3c4cda26604c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207a7992-197f-4195-90e5-5e0bbf629cd7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc43091-0f63-4489-aa16-6f0616c8c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:15 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Volume volume-207a7992-197f-4195-90e5-5e0bbf629cd7 (207a7992-197f-4195-90e5-5e0bbf629cd7): created successfully Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc43091-0f63-4489-aa16-6f0616c8c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Flow 'volume_create_manager' (0b33afe0-749f-40b3-918c-a3370ec3b48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d451bfde-9bf9-44a7-9d4d-e90b4abdb028 tempest-VolumesActionsTest-1062060270 None] Created volume successfully. Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=85,cinder:INSERT=24,cinder:UPDATE=103,cinder:DELETE=2 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=74,cinder:SELECT=78,cinder:INSERT=28,cinder:DELETE=6 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Acquiring lock "cinder-7c8826d3-c8fc-41c7-b227-8f09bac90b9b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "cinder-7c8826d3-c8fc-41c7-b227-8f09bac90b9b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Acquiring lock "cinder-quobyte-7c8826d3-c8fc-41c7-b227-8f09bac90b9b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "cinder-quobyte-7c8826d3-c8fc-41c7-b227-8f09bac90b9b" acquired by "delete_volume" :: waited 0.039s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64819f3-33a9-4121-8cad-39a14dd129d0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:25 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b Apr 22 08:56:25 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:26 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b" returned: 0 in 1.021s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:26 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b Apr 22 08:56:26 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:27 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c8826d3-c8fc-41c7-b227-8f09bac90b9b" returned: 0 in 0.728s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "cinder-quobyte-7c8826d3-c8fc-41c7-b227-8f09bac90b9b" released by "delete_volume" :: held 1.830s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Created reservations ['0fdf862f-e466-44c3-8146-d5edeeb87967', 'f23855b7-366d-4b96-8704-08dc6b4e739c', '22e8f371-6b37-4385-b04d-621b7a6e1d8d', 'b613aae3-f428-44aa-92f7-8aeaf5494060'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:27 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:27 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:28 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.092s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:28 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:28 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Deleted volume successfully. Apr 22 08:56:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fd2756ee-c7e8-491c-8119-8da3297a913d tempest-ServerRescueNegativeTestJSON-133798928 None] Lock "cinder-7c8826d3-c8fc-41c7-b227-8f09bac90b9b-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Flow 'volume_create_manager' (00744267-0486-4c1f-9fe4-cf3dcb3d453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf697f7-4eaf-46ce-b150-1144bdd452fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf697f7-4eaf-46ce-b150-1144bdd452fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1278818058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d0c05d-0e6d-4182-baf8-2a9023a7f15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43747597818040c7b9c306f336182736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:31Z,use_quota=True,user_id='94616fa00abc45bb84e270b568a2314f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f10c0f07-6f93-47ae-bf15-15532e494d9e),volume_type_id=f10c0f07-6f93-47ae-bf15-15532e494d9e)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e9f4e9-3d1c-42d1-a1c7-f178fc652d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e9f4e9-3d1c-42d1-a1c7-f178fc652d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8861062b-3fa2-4529-b7d7-26af7f262d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8861062b-3fa2-4529-b7d7-26af7f262d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d0c05d-0e6d-4182-baf8-2a9023a7f15f', 'volume_name': 'volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22b02cf-2610-4f2c-9792-4eeb378b1e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22b02cf-2610-4f2c-9792-4eeb378b1e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19a3d96-99b7-4bce-8198-f828fd1af19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Volume d2d0c05d-0e6d-4182-baf8-2a9023a7f15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f', 'volume_size': 1} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1278818058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d0c05d-0e6d-4182-baf8-2a9023a7f15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43747597818040c7b9c306f336182736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:31Z,use_quota=True,user_id='94616fa00abc45bb84e270b568a2314f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f10c0f07-6f93-47ae-bf15-15532e494d9e),volume_type_id=f10c0f07-6f93-47ae-bf15-15532e494d9e)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Creating volume d2d0c05d-0e6d-4182-baf8-2a9023a7f15f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:56:30 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:56:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:30 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f 1073741824 Apr 22 08:56:30 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:31 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f 1073741824" returned: 0 in 0.774s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:31 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f Apr 22 08:56:31 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:32 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f" returned: 0 in 0.927s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19a3d96-99b7-4bce-8198-f828fd1af19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e8d649-55af-4ac4-b010-999998b82686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:32 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Volume volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f (d2d0c05d-0e6d-4182-baf8-2a9023a7f15f): created successfully Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e8d649-55af-4ac4-b010-999998b82686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Flow 'volume_create_manager' (00744267-0486-4c1f-9fe4-cf3dcb3d453f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-26eade0c-b438-4d36-a8da-5cc5c398acc5 tempest-VolumeTypesAccessTest-1137908643 None] Created volume successfully. Apr 22 08:56:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Acquiring lock "cinder-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Lock "cinder-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Acquiring lock "cinder-quobyte-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Lock "cinder-quobyte-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f" acquired by "delete_volume" :: waited 0.018s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:33 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d4032-843a-4e4b-aa63-afde34c80e24]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:33 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f Apr 22 08:56:33 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:34 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f" returned: 0 in 1.187s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:34 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f Apr 22 08:56:34 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:35 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f" returned: 0 in 0.713s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Lock "cinder-quobyte-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f" released by "delete_volume" :: held 2.039s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:35 devstack cinder-volume[83774]: WARNING cinder.quota [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1335903369 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1335903369, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:56:35 devstack cinder-volume[83774]: WARNING cinder.quota [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1335903369 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1335903369, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Created reservations ['386e9281-b5a1-45eb-a486-ed94364677bd', '0d7b2150-45fa-46bb-8573-357ae687b160', '0430371a-0924-4bc3-ac07-c23f80b5b0d0', '52d21b2c-2f27-4b29-bec4-fa678b999557'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:35 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:35 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:36 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.070s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:36 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Deleted volume successfully. Apr 22 08:56:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8eb3ba4f-ed64-4e07-b8dc-0356fcce93a2 tempest-VolumeTypesAccessTest-1137908643 None] Lock "cinder-d2d0c05d-0e6d-4182-baf8-2a9023a7f15f-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3b3f0e3b-86a5-4322-b89a-dc5817af81d2 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7" by "attach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3b3f0e3b-86a5-4322-b89a-dc5817af81d2 tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7" acquired by "attach_volume" :: waited 0.033s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3b3f0e3b-86a5-4322-b89a-dc5817af81d2 tempest-VolumesActionsTest-1062060270 None] Attaching volume 207a7992-197f-4195-90e5-5e0bbf629cd7 to instance a0470ecf-dc8a-4fa3-bbe6-67b86f95cfa7 at mountpoint /dev/vdb on host None. Apr 22 08:56:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3b3f0e3b-86a5-4322-b89a-dc5817af81d2 tempest-VolumesActionsTest-1062060270 None] Attach volume completed successfully. Apr 22 08:56:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3b3f0e3b-86a5-4322-b89a-dc5817af81d2 tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7" released by "attach_volume" :: held 0.206s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9e711a0a-cbee-4974-9e21-12917419314d tempest-VolumesActionsTest-1062060270 None] Acquiring lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-detach_volume" by "detach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9e711a0a-cbee-4974-9e21-12917419314d tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9e711a0a-cbee-4974-9e21-12917419314d tempest-VolumesActionsTest-1062060270 None] Detaching volume 207a7992-197f-4195-90e5-5e0bbf629cd7 from instance a0470ecf-dc8a-4fa3-bbe6-67b86f95cfa7. Apr 22 08:56:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9e711a0a-cbee-4974-9e21-12917419314d tempest-VolumesActionsTest-1062060270 None] Detach volume completed successfully. Apr 22 08:56:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9e711a0a-cbee-4974-9e21-12917419314d tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:56:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Flow 'volume_create_manager' (a117226a-4d40-48e8-8774-663fd49d5546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934a56f-9a64-4932-b826-6869e24b099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d934a56f-9a64-4932-b826-6869e24b099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949545974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78b99a8-1f58-41b8-8ff6-b3b46295956c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4fb1fe77034b169a97eae540f23523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:43Z,use_quota=True,user_id='969dc4569de94e36b3c5ce68c2b9a733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601f639b-a3cf-4d22-b148-98a15bb7cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601f639b-a3cf-4d22-b148-98a15bb7cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d7e2c2-f402-4a12-843b-2ab4e1ddf616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d7e2c2-f402-4a12-843b-2ab4e1ddf616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78b99a8-1f58-41b8-8ff6-b3b46295956c', 'volume_name': 'volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e438608-63bc-436d-99ec-35945a403223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e438608-63bc-436d-99ec-35945a403223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c9f89a-72da-4a53-aa73-3b4663c9c8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Volume c78b99a8-1f58-41b8-8ff6-b3b46295956c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c', 'volume_size': 1} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949545974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78b99a8-1f58-41b8-8ff6-b3b46295956c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4fb1fe77034b169a97eae540f23523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:43Z,use_quota=True,user_id='969dc4569de94e36b3c5ce68c2b9a733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Creating volume c78b99a8-1f58-41b8-8ff6-b3b46295956c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:56:43 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:43 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c 1073741824 Apr 22 08:56:43 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:43 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c 1073741824" returned: 0 in 0.588s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:43 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c Apr 22 08:56:43 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:44 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c" returned: 0 in 0.645s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c9f89a-72da-4a53-aa73-3b4663c9c8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a7d240-1ebd-4803-ac33-42b9534aebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:44 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Volume volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c (c78b99a8-1f58-41b8-8ff6-b3b46295956c): created successfully Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a7d240-1ebd-4803-ac33-42b9534aebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Flow 'volume_create_manager' (a117226a-4d40-48e8-8774-663fd49d5546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:44 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-58ef9c35-624a-4e36-8e4d-7d4cb07870d1 tempest-VolumesListAdminTestJSON-1874811605 None] Created volume successfully. Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Flow 'volume_create_manager' (fcd2a65f-9378-4715-b02c-26737638ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9199a342-6430-4eac-a7e2-49e78b1e1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9199a342-6430-4eac-a7e2-49e78b1e1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233420530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7427a5e-dad4-4a0e-bf27-d6f6178eb10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4fb1fe77034b169a97eae540f23523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:46Z,use_quota=True,user_id='969dc4569de94e36b3c5ce68c2b9a733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7393e26f-c71d-4b81-8f98-3bf555e97d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7393e26f-c71d-4b81-8f98-3bf555e97d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0785f710-c7d9-4de1-aafe-ee2c509f195d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0785f710-c7d9-4de1-aafe-ee2c509f195d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7427a5e-dad4-4a0e-bf27-d6f6178eb10f', 'volume_name': 'volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bab9490-f0df-4f70-ba05-0005033b7e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bab9490-f0df-4f70-ba05-0005033b7e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9126ee5-d8b9-41a1-8154-cc6f4d88bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:45 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Volume f7427a5e-dad4-4a0e-bf27-d6f6178eb10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f', 'volume_size': 1} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233420530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7427a5e-dad4-4a0e-bf27-d6f6178eb10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4fb1fe77034b169a97eae540f23523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:46Z,use_quota=True,user_id='969dc4569de94e36b3c5ce68c2b9a733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Creating volume f7427a5e-dad4-4a0e-bf27-d6f6178eb10f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:56:45 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:56:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:45 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f 1073741824 Apr 22 08:56:45 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:46 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f 1073741824" returned: 0 in 0.612s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:46 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f Apr 22 08:56:46 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:46 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f" returned: 0 in 0.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9126ee5-d8b9-41a1-8154-cc6f4d88bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3d0df1-9ae5-46ac-8eec-c923e2417801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:46 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Volume volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f (f7427a5e-dad4-4a0e-bf27-d6f6178eb10f): created successfully Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3d0df1-9ae5-46ac-8eec-c923e2417801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Flow 'volume_create_manager' (fcd2a65f-9378-4715-b02c-26737638ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-22df3a94-53ea-45a4-b5d9-0e9c9e3b8bde tempest-VolumesListAdminTestJSON-1874811605 None] Created volume successfully. Apr 22 08:56:47 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Flow 'volume_create_manager' (e3b83388-1dac-49f2-a314-b43e81002895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6600e396-8c27-4566-8ea0-2c1f14a448e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6600e396-8c27-4566-8ea0-2c1f14a448e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-57194422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c07d2bf-e588-472e-b2e5-d2849636ee1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4fb1fe77034b169a97eae540f23523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:48Z,use_quota=True,user_id='969dc4569de94e36b3c5ce68c2b9a733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a17301a-6cb4-473a-bcf5-81cde5587aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a17301a-6cb4-473a-bcf5-81cde5587aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d07a2f1-5faa-4730-a5c6-4dce15ddac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d07a2f1-5faa-4730-a5c6-4dce15ddac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c07d2bf-e588-472e-b2e5-d2849636ee1c', 'volume_name': 'volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58474e77-71bb-42b7-8841-c0d87eb403ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58474e77-71bb-42b7-8841-c0d87eb403ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965294bf-7fc1-488f-a9db-a628ca09144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:48 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Volume 1c07d2bf-e588-472e-b2e5-d2849636ee1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c', 'volume_size': 1} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-57194422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c07d2bf-e588-472e-b2e5-d2849636ee1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4fb1fe77034b169a97eae540f23523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:48Z,use_quota=True,user_id='969dc4569de94e36b3c5ce68c2b9a733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Creating volume 1c07d2bf-e588-472e-b2e5-d2849636ee1c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:56:48 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:48 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c 1073741824 Apr 22 08:56:48 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:48 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c 1073741824" returned: 0 in 0.601s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:48 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c Apr 22 08:56:48 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:49 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965294bf-7fc1-488f-a9db-a628ca09144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b6bc9c-ae9e-4f00-984f-f42cd3d8f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Volume volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c (1c07d2bf-e588-472e-b2e5-d2849636ee1c): created successfully Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b6bc9c-ae9e-4f00-984f-f42cd3d8f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Flow 'volume_create_manager' (e3b83388-1dac-49f2-a314-b43e81002895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:49 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7ad181d6-02de-4de4-bbd7-9c25794fe890 tempest-VolumesListAdminTestJSON-1874811605 None] Created volume successfully. Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Flow 'volume_create_manager' (e23f80f6-96bb-4315-9016-ce2d6060dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337bce8d-3dd6-41eb-a9fb-ada069108561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337bce8d-3dd6-41eb-a9fb-ada069108561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bf4484-371c-4045-8f96-e09aaf1acd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea683799ffa43c99410e4e8e045d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:51Z,use_quota=True,user_id='30b016f54eb64561b45c8ab081e479fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8775a5e2-305b-4a67-a4e0-30bb14db9c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8775a5e2-305b-4a67-a4e0-30bb14db9c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23a3cb5-c969-4c29-92ad-12dfef6fe331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23a3cb5-c969-4c29-92ad-12dfef6fe331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bf4484-371c-4045-8f96-e09aaf1acd87', 'volume_name': 'volume-b8bf4484-371c-4045-8f96-e09aaf1acd87', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb50a09-adcc-47fb-a1e2-b772bf93a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb50a09-adcc-47fb-a1e2-b772bf93a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359628d5-460e-4a04-a75c-28bc03c838b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Volume b8bf4484-371c-4045-8f96-e09aaf1acd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bf4484-371c-4045-8f96-e09aaf1acd87', 'volume_size': 1} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bf4484-371c-4045-8f96-e09aaf1acd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea683799ffa43c99410e4e8e045d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:56:51Z,use_quota=True,user_id='30b016f54eb64561b45c8ab081e479fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Creating volume b8bf4484-371c-4045-8f96-e09aaf1acd87 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:56:50 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:56:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:50 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 1073741824 Apr 22 08:56:50 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:51 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 1073741824" returned: 0 in 0.651s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:51 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 Apr 22 08:56:51 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:51 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87" returned: 0 in 0.534s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359628d5-460e-4a04-a75c-28bc03c838b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bf4484-371c-4045-8f96-e09aaf1acd87', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8720e02e-c26e-43ad-a45a-90c683cbbde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:56:51 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Volume volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 (b8bf4484-371c-4045-8f96-e09aaf1acd87): created successfully Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8720e02e-c26e-43ad-a45a-90c683cbbde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:56:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Flow 'volume_create_manager' (e23f80f6-96bb-4315-9016-ce2d6060dc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:56:51 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-57756121-bcdd-4a6b-a654-0dd125abed78 tempest-VolumesListAdminTestJSON-1468136829 None] Created volume successfully. Apr 22 08:56:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Acquiring lock "cinder-b8bf4484-371c-4045-8f96-e09aaf1acd87-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "cinder-b8bf4484-371c-4045-8f96-e09aaf1acd87-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Acquiring lock "cinder-quobyte-b8bf4484-371c-4045-8f96-e09aaf1acd87" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "cinder-quobyte-b8bf4484-371c-4045-8f96-e09aaf1acd87" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e92661-c089-4241-a94f-cf1b2c56ebc5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "cinder-1c07d2bf-e588-472e-b2e5-d2849636ee1c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-1c07d2bf-e588-472e-b2e5-d2849636ee1c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "cinder-quobyte-1c07d2bf-e588-472e-b2e5-d2849636ee1c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:53 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 Apr 22 08:56:53 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-quobyte-1c07d2bf-e588-472e-b2e5-d2849636ee1c" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b83b70d-0749-4f0c-9971-da8a8c5380dd]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:53 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c Apr 22 08:56:53 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:53 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87" returned: 0 in 0.757s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:53 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c" returned: 0 in 0.600s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:53 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87 Apr 22 08:56:53 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:53 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c Apr 22 08:56:53 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:54 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1c07d2bf-e588-472e-b2e5-d2849636ee1c" returned: 0 in 0.580s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-quobyte-1c07d2bf-e588-472e-b2e5-d2849636ee1c" released by "delete_volume" :: held 1.208s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Created reservations ['75b09776-820e-40ce-9de1-5883aaf0c293', '7b9cb02b-a987-4aff-992d-4d448729695a', '75a4744f-1d00-4348-b6a5-c0ab91720281', '3bee5f47-41cf-4f67-aeae-ffc82f396769'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:54 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bf4484-371c-4045-8f96-e09aaf1acd87" returned: 0 in 0.722s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "cinder-quobyte-b8bf4484-371c-4045-8f96-e09aaf1acd87" released by "delete_volume" :: held 1.515s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Created reservations ['0659a2ff-4611-41c8-9c39-a5afa033d7ae', '456adacb-af45-439c-acb9-9be084b82f2a', '31341172-b3d3-40cf-a97f-c4d2ee50ce84', '72d6085f-5caf-429c-aa2a-2b35e7182b16'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:54 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:54 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:54 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:54 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:55 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.760s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Deleted volume successfully. Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-44f197d3-f841-4e7f-a6fd-5564a5b0c6ba tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-1c07d2bf-e588-472e-b2e5-d2849636ee1c-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:55 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.733s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Deleted volume successfully. Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bb6735e6-49fd-4b0a-8757-ef4d8cf1f7d6 tempest-VolumesListAdminTestJSON-1468136829 None] Lock "cinder-b8bf4484-371c-4045-8f96-e09aaf1acd87-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "cinder-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "cinder-quobyte-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-quobyte-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[510a840e-60cb-4837-b1a0-1616e29ff0b5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:55 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f Apr 22 08:56:55 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:56 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f" returned: 0 in 0.613s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:56 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f Apr 22 08:56:56 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:56 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f" returned: 0 in 0.531s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-quobyte-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f" released by "delete_volume" :: held 1.186s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Created reservations ['bfdb00ae-ea8d-44f8-a19a-3d3a62a60d45', '36112d4d-6666-40db-a3d6-1d24c2392095', 'b70f04c3-6763-410c-8dee-79110d9010f3', 'c1df615e-524f-4d5f-8fe6-49675c3b32d5'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:56 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:56 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:57 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Deleted volume successfully. Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cd593269-253a-411a-bfd3-cbaaf2865ae7 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-f7427a5e-dad4-4a0e-bf27-d6f6178eb10f-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "cinder-c78b99a8-1f58-41b8-8ff6-b3b46295956c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-c78b99a8-1f58-41b8-8ff6-b3b46295956c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "cinder-quobyte-c78b99a8-1f58-41b8-8ff6-b3b46295956c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-quobyte-c78b99a8-1f58-41b8-8ff6-b3b46295956c" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79da7be-34a2-475d-9b49-44111ca2ef30]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:56:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:57 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c Apr 22 08:56:57 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:58 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c" returned: 0 in 0.517s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:58 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c Apr 22 08:56:58 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:58 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c78b99a8-1f58-41b8-8ff6-b3b46295956c" returned: 0 in 0.416s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-quobyte-c78b99a8-1f58-41b8-8ff6-b3b46295956c" released by "delete_volume" :: held 0.961s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Created reservations ['bb09bce3-535d-43ba-b3db-97f035fc08ba', 'e9e84db9-feae-49ff-8968-893b6ed72a78', 'ec086a5c-2957-4c5c-a659-572436659eaf', 'b64dff12-62ff-4d54-8ebd-97402b928f55'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:56:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:56:58 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:56:58 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:56:59 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 22 08:56:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:56:59 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:56:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Deleted volume successfully. Apr 22 08:56:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6d51ac78-e3af-4607-afcd-99a4feadd279 tempest-VolumesListAdminTestJSON-1874811605 None] Lock "cinder-c78b99a8-1f58-41b8-8ff6-b3b46295956c-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:01 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Flow 'volume_create_manager' (abd66cd3-b20a-4379-bc70-1df72604921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52197f-fce7-4cb0-adee-5108aaf8f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52197f-fce7-4cb0-adee-5108aaf8f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1047906355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a986e993-11d9-4b92-8a38-2ec2dbd283fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71477e12cef84b929007f496d0b9026c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:02Z,use_quota=True,user_id='1d90b2c22aee4030b67eb8cf1e621e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98215a9-f790-438b-ba66-72d8c80c9f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98215a9-f790-438b-ba66-72d8c80c9f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b1b015-74d3-48b3-8fd3-b99a5afceeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b1b015-74d3-48b3-8fd3-b99a5afceeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a986e993-11d9-4b92-8a38-2ec2dbd283fb', 'volume_name': 'volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec13069-9c57-4b79-a326-c0ff8aaca63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec13069-9c57-4b79-a326-c0ff8aaca63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75860929-ab0b-42ee-a51f-e1209d847096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:02 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Volume a986e993-11d9-4b92-8a38-2ec2dbd283fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb', 'volume_size': 1} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1047906355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a986e993-11d9-4b92-8a38-2ec2dbd283fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71477e12cef84b929007f496d0b9026c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:02Z,use_quota=True,user_id='1d90b2c22aee4030b67eb8cf1e621e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Creating volume a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:57:02 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:57:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:02 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb 1073741824 Apr 22 08:57:02 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:03 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb 1073741824" returned: 0 in 1.054s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:03 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb Apr 22 08:57:03 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:04 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb" returned: 0 in 0.859s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75860929-ab0b-42ee-a51f-e1209d847096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a52c2f-669d-41bb-903f-950e8baf10fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:04 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Volume volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb (a986e993-11d9-4b92-8a38-2ec2dbd283fb): created successfully Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a52c2f-669d-41bb-903f-950e8baf10fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Flow 'volume_create_manager' (abd66cd3-b20a-4379-bc70-1df72604921a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:04 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e219f162-b528-494a-a432-12773fb3e1ae tempest-SnapshotMetadataTestJSON-1066754213 None] Created volume successfully. Apr 22 08:57:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Creating offline snapshot a85b99cc-19a0-4915-8364-c452a8ad749e of volume a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:57:05 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d2d3a8-9253-46f2-a247-ccbab0664d62]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:05 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb Apr 22 08:57:05 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-19be9760-5590-4228-bc0c-0fca5b5912ed tempest-VolumesActionsTest-1062060270 None] Acquiring lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7" by "attach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-19be9760-5590-4228-bc0c-0fca5b5912ed tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7" acquired by "attach_volume" :: waited 0.018s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-19be9760-5590-4228-bc0c-0fca5b5912ed tempest-VolumesActionsTest-1062060270 None] Attaching volume 207a7992-197f-4195-90e5-5e0bbf629cd7 to instance 9b9d6b02-aeb7-4315-b139-a09459d07658 at mountpoint /dev/vdb on host None. Apr 22 08:57:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-19be9760-5590-4228-bc0c-0fca5b5912ed tempest-VolumesActionsTest-1062060270 None] Attach volume completed successfully. Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-19be9760-5590-4228-bc0c-0fca5b5912ed tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7" released by "attach_volume" :: held 0.075s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:06 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb" returned: 0 in 1.007s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:06 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e 1G Apr 22 08:57:06 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-47b73b5c-e15e-48c2-b3b8-f97f340a87dd tempest-VolumesActionsTest-1062060270 None] Acquiring lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-detach_volume" by "detach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-47b73b5c-e15e-48c2-b3b8-f97f340a87dd tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-47b73b5c-e15e-48c2-b3b8-f97f340a87dd tempest-VolumesActionsTest-1062060270 None] Detaching volume 207a7992-197f-4195-90e5-5e0bbf629cd7 from instance 9b9d6b02-aeb7-4315-b139-a09459d07658. Apr 22 08:57:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-47b73b5c-e15e-48c2-b3b8-f97f340a87dd tempest-VolumesActionsTest-1062060270 None] Detach volume completed successfully. Apr 22 08:57:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-47b73b5c-e15e-48c2-b3b8-f97f340a87dd tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:07 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e 1G" returned: 0 in 0.758s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:07 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e Apr 22 08:57:07 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:08 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e" returned: 0 in 1.171s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:08 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e is being set with open permissions: ugo+rw Apr 22 08:57:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:08 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e Apr 22 08:57:08 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:09 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e" returned: 0 in 0.901s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:09 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info Apr 22 08:57:09 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:10 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info" returned: 0 in 0.965s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:10 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info is being set with open permissions: ugo+rw Apr 22 08:57:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:10 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info Apr 22 08:57:10 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:10 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.info" returned: 0 in 0.576s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.516s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:11 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a4ac51c3-c2b0-4fb0-8554-03583b6c5a16 tempest-SnapshotMetadataTestJSON-1066754213 None] Create snapshot completed successfully Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "cinder-a85b99cc-19a0-4915-8364-c452a8ad749e-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-a85b99cc-19a0-4915-8364-c452a8ad749e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "cinder-quobyte-a986e993-11d9-4b92-8a38-2ec2dbd283fb" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-quobyte-a986e993-11d9-4b92-8a38-2ec2dbd283fb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "cinder-quobyte-a85b99cc-19a0-4915-8364-c452a8ad749e" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-quobyte-a85b99cc-19a0-4915-8364-c452a8ad749e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Deleting offline snapshot a85b99cc-19a0-4915-8364-c452a8ad749e of volume a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] snapshot_file for this snap is: volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b147e-351c-4d4c-9624-bb1cd5371f61]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:12 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e Apr 22 08:57:12 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:12 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:57:12 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:14 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e" returned: 0 in 1.382s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d30c6c3-cd7f-4953-ba0e-e8c3ad594a3a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:14 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.246s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:57:14 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb Apr 22 08:57:14 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:14 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb" returned: 0 in 0.810s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:14 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e Apr 22 08:57:14 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:15 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e" returned: 0 in 1.076s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:16 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e Apr 22 08:57:16 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:16 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb.a85b99cc-19a0-4915-8364-c452a8ad749e" returned: 0 in 0.860s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-quobyte-a85b99cc-19a0-4915-8364-c452a8ad749e" released by "_delete_snapshot" :: held 4.367s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-quobyte-a986e993-11d9-4b92-8a38-2ec2dbd283fb" released by "delete_snapshot" :: held 4.385s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Created reservations ['93172b98-dba6-4210-958c-c11378ff4dc6', '621ae9aa-2a20-4baf-b59c-16abba58e545', '51523bdb-f2e4-4cd4-a607-783e5db1b695', 'a6356f80-2e8c-4ac6-a8a9-ff969c05d548'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc49057c-151e-4043-854e-b9db97e73d82]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:17 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Delete snapshot completed successfully. Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-09647c1a-2830-49c1-ba7e-08ea26e80b8a tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-a85b99cc-19a0-4915-8364-c452a8ad749e-delete_snapshot" released by "delete_snapshot" :: held 4.571s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:17 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:17 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:17 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.572s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ccadcb-bfd7-4146-b999-fe5200d88b50]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:17 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:17 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "cinder-a986e993-11d9-4b92-8a38-2ec2dbd283fb-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-a986e993-11d9-4b92-8a38-2ec2dbd283fb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "cinder-quobyte-a986e993-11d9-4b92-8a38-2ec2dbd283fb" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-quobyte-a986e993-11d9-4b92-8a38-2ec2dbd283fb" acquired by "delete_volume" :: waited 0.046s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a219fb6-d8e8-4f98-a33a-dcc8f210869e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:18 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb Apr 22 08:57:18 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:18 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.681s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.744a72ec-35c9-4957-98d0-3c679ab59c36uy6s2rki.img {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:18 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.744a72ec-35c9-4957-98d0-3c679ab59c36uy6s2rki.img Apr 22 08:57:18 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:18 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb" returned: 0 in 0.574s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:18 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb Apr 22 08:57:18 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:19 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a986e993-11d9-4b92-8a38-2ec2dbd283fb" returned: 0 in 1.092s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-quobyte-a986e993-11d9-4b92-8a38-2ec2dbd283fb" released by "delete_volume" :: held 1.769s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:19 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Created reservations ['f1566072-d923-4824-892c-b0b29a5808ce', 'd9969fbf-ef95-4cb8-aa36-9ece43232072', '559d7f5b-5329-4783-b4af-8706540dc0d6', '170ad1a2-a766-4974-a7ec-9ef71e8b9f41'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:57:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:20 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:57:20 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:22 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 2.054s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:22 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:57:22 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Deleted volume successfully. Apr 22 08:57:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-3923d3fc-b089-4d00-bbbc-d02313413c13 tempest-SnapshotMetadataTestJSON-1066754213 None] Lock "cinder-a986e993-11d9-4b92-8a38-2ec2dbd283fb-delete_volume" released by "delete_volume" :: held 4.301s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:23 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.744a72ec-35c9-4957-98d0-3c679ab59c36uy6s2rki.img" returned: 0 in 4.852s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd86d3f-ba40-4af0-8339-9b9b7140b06d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:23 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:23 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:24 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.853s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:24 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.744a72ec-35c9-4957-98d0-3c679ab59c36uy6s2rki.img {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:57:24 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Converted 1024.00 MB image at 211.00 MB/s Apr 22 08:57:24 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] 744a72ec-35c9-4957-98d0-3c679ab59c36 was raw, no need to convert to raw {{(pid=83774) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Flow 'volume_create_manager' (afbc0ef4-b7a2-4966-ba80-109bcbd39402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f512ccfc-164f-4ec7-84e8-a436d5b56485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f512ccfc-164f-4ec7-84e8-a436d5b56485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:25Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf10e37-8ff4-4a84-b09d-ee4630a9c336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727c694b7674bd9801cf63a4cc9cc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:25Z,use_quota=True,user_id='c145b4bfb33e471f8c574fb5bc0527c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67093f55-c570-48e9-a65e-59e4b9f60f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67093f55-c570-48e9-a65e-59e4b9f60f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1ab6a2-ecd6-4bc8-a028-9c5dbdfd5cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.image.glance [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Creating Keystone auth plugin from conf {{(pid=83774) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1ab6a2-ecd6-4bc8-a028-9c5dbdfd5cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdf10e37-8ff4-4a84-b09d-ee4630a9c336', 'volume_name': 'volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef662ba-af99-41b2-886e-61441c5617da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef662ba-af99-41b2-886e-61441c5617da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cadeed-ce87-4f51-bacc-7d82d870960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:25 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Volume fdf10e37-8ff4-4a84-b09d-ee4630a9c336: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 08:57:25 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Trying to clone fdf10e37-8ff4-4a84-b09d-ee4630a9c336 from image 403fb852-3ee8-4a92-abbf-1734c0db4994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]). {{(pid=83774) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 08:57:26 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 08:57:26 devstack cinder-volume[83774]: INFO cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Image download 20.69 MB at 20.69 MB/s Apr 22 08:57:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaea43c1-0d89-4cd4-9e8d-7d6874083e2a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:26 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD Apr 22 08:57:26 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:27 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD" returned: 0 in 1.299s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:27 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 is fetched for user c145b4bfb33e471f8c574fb5bc0527c9. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 08:57:27 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=102,cinder:SELECT=72,cinder:INSERT=26,cinder:DELETE=7 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:57:27 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=73,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=7 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:57:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[61539b5f-c230-49ff-85ab-b6969ca6bd44]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:27 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD Apr 22 08:57:27 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Flow 'volume_create_manager' (50839569-85ae-4b65-ae5d-749e589a10cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a047323-c89b-4e71-b05c-cf8be195705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a047323-c89b-4e71-b05c-cf8be195705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-102075173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a83fa15-859b-4215-a386-2b5832c04543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bac46f4844505910fbd6343d10228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:28Z,use_quota=True,user_id='f22b4352e65c4ed482b8a0b93eed3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7873b06-53ec-400a-abc2-9e6c9cbed503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7873b06-53ec-400a-abc2-9e6c9cbed503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ed9c40-1614-4ce3-ac8f-dc13fbdd267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ed9c40-1614-4ce3-ac8f-dc13fbdd267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a83fa15-859b-4215-a386-2b5832c04543', 'volume_name': 'volume-0a83fa15-859b-4215-a386-2b5832c04543', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc24b85-cf56-4a59-8d07-8b325302ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc24b85-cf56-4a59-8d07-8b325302ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8482f4d8-d3a9-49b5-a61c-c121eb9807a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:28 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Volume 0a83fa15-859b-4215-a386-2b5832c04543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a83fa15-859b-4215-a386-2b5832c04543', 'volume_size': 1} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:28 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD" returned: 0 in 1.280s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:38 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=2 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.712s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Uploaded volume to glance image-id: 744a72ec-35c9-4957-98d0-3c679ab59c36. {{(pid=83774) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.429s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-102075173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a83fa15-859b-4215-a386-2b5832c04543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bac46f4844505910fbd6343d10228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:28Z,use_quota=True,user_id='f22b4352e65c4ed482b8a0b93eed3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Creating volume 0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:57:40 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:57:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:40 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0c636f5f-be9c-4a69-8ac4-4177857f08d6 tempest-VolumesActionsTest-1062060270 None] Copy volume to image completed successfully. Apr 22 08:57:40 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 1073741824 Apr 22 08:57:40 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:41 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 1073741824" returned: 0 in 1.007s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:41 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 Apr 22 08:57:41 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:42 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543" returned: 0 in 0.493s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.347s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:25Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf10e37-8ff4-4a84-b09d-ee4630a9c336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727c694b7674bd9801cf63a4cc9cc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:25Z,use_quota=True,user_id='c145b4bfb33e471f8c574fb5bc0527c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Creating volume fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:57:42 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8482f4d8-d3a9-49b5-a61c-c121eb9807a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a83fa15-859b-4215-a386-2b5832c04543', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8708b383-2cb8-413b-8c07-e1a5e7f3f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:42 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 1073741824 Apr 22 08:57:42 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Volume volume-0a83fa15-859b-4215-a386-2b5832c04543 (0a83fa15-859b-4215-a386-2b5832c04543): created successfully Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8708b383-2cb8-413b-8c07-e1a5e7f3f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Flow 'volume_create_manager' (50839569-85ae-4b65-ae5d-749e589a10cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a9685fd6-65d9-413c-9fbd-a1b4af0445d8 tempest-VolumesDeleteCascade-767543376 None] Created volume successfully. Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:42 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 1073741824" returned: 0 in 0.538s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:42 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:57:42 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Flow 'volume_create_manager' (0ca9301a-1b2e-4f26-81ac-e1a0b4c30855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985d3498-5120-4bf3-ab4d-7999f8db18e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985d3498-5120-4bf3-ab4d-7999f8db18e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1342231396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9574821d-434c-4bc3-9b4b-fa9630a1f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88eadf05d5349eaacd7bbfd8d2390a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:43Z,use_quota=True,user_id='9da779b725bd4ddd85e4aa68fcac760f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a3d2d4-b4fd-45d0-a4a1-6460933c68ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a3d2d4-b4fd-45d0-a4a1-6460933c68ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df77b308-07d0-44a8-8f87-5742b94c5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df77b308-07d0-44a8-8f87-5742b94c5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9574821d-434c-4bc3-9b4b-fa9630a1f1a7', 'volume_name': 'volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412b1f84-c105-4af8-ac1e-12dda0ba7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412b1f84-c105-4af8-ac1e-12dda0ba7090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfdfa13-9b90-4ead-975d-bfcd335834a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Volume 9574821d-434c-4bc3-9b4b-fa9630a1f1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7', 'volume_size': 1} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:43 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 0 in 0.536s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.446s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd42eaaa-1ca4-4747-b0f0-70d00ef68cbc]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Attempting download of 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume fdf10e37-8ff4-4a84-b09d-ee4630a9c336. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc8c7ac-31cd-493f-a8f6-6126ceb023b1]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:43 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:43 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:43 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai Apr 22 08:57:43 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:44 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.637s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be93b4-ccc6-48ac-a598-c4e09df9ec35]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:44 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:44 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:44 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai" returned: 0 in 0.721s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:44 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai Apr 22 08:57:44 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:44 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.646s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:44 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img Apr 22 08:57:44 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:44 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai" returned: 1 in 0.543s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_c9pul1ai' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94db711-95ce-4c03-9f0b-83b8bb8fe94c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:44 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD Apr 22 08:57:44 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:45 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD" returned: 0 in 1.275s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:45 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] 403fb852-3ee8-4a92-abbf-1734c0db4994 was qcow2, converting to raw {{(pid=83774) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 08:57:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:46 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:57:46 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:47 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img" returned: 0 in 2.909s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:47 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7496d50-da8b-447e-8da1-3e852dbb3d10]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:47 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:47 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:47 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 0 in 1.820s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:47 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_nahm8p4_devstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:57:47 devstack cinder-volume[83774]: INFO cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Converted 112.00 MB image at 61.48 MB/s Apr 22 08:57:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:47 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 1G Apr 22 08:57:47 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:48 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.705s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7, size 1024.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:57:48 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Converted 1024.00 MB image at 351.86 MB/s Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] e4b39499-2fb8-413a-9890-ca452e99daed was raw, converting to qcow2 {{(pid=83774) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 22 08:57:48 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 1G" returned: 0 in 0.515s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e767b-9b59-4820-932c-293c2f12b4c9]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b773ff3-3570-4478-a802-b9a9bfc824cb]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:48 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img Apr 22 08:57:48 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:48 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:57:48 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:48 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:48 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img Apr 22 08:57:48 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:48 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 0 in 0.614s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:49 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:57:49 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:49 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img" returned: 1 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img /opt/stack/data/cinder/conversion/vol_upload_w85ir95r {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:49 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img /opt/stack/data/cinder/conversion/vol_upload_w85ir95r Apr 22 08:57:49 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:49 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 1 in 0.492s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Downloaded image 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume fdf10e37-8ff4-4a84-b09d-ee4630a9c336 successfully. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 for user c145b4bfb33e471f8c574fb5bc0527c9 is deleted. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Marking volume fdf10e37-8ff4-4a84-b09d-ee4630a9c336 as bootable. {{(pid=83774) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Copying metadata from image 403fb852-3ee8-4a92-abbf-1734c0db4994 to fdf10e37-8ff4-4a84-b09d-ee4630a9c336. {{(pid=83774) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Creating volume glance metadata for volume fdf10e37-8ff4-4a84-b09d-ee4630a9c336 backed by image 403fb852-3ee8-4a92-abbf-1734c0db4994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83774) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cadeed-ce87-4f51-bacc-7d82d870960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfe4b61-98ad-4ccd-956e-e662233b3942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Volume volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 (fdf10e37-8ff4-4a84-b09d-ee4630a9c336): created successfully Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfe4b61-98ad-4ccd-956e-e662233b3942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Flow 'volume_create_manager' (afbc0ef4-b7a2-4966-ba80-109bcbd39402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:49 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-c91ff656-2710-4607-a506-23060ac16728 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Created volume successfully. Apr 22 08:57:49 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img /opt/stack/data/cinder/conversion/vol_upload_w85ir95r" returned: 0 in 0.536s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Image conversion details: src /opt/stack/data/cinder/conversion/207a7992-197f-4195-90e5-5e0bbf629cd7.temp_image.e4b39499-2fb8-413a-9890-ca452e99daedoyfny_l0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w85ir95r {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:57:49 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e55ab4-7e49-4e3c-a31b-1f60e63018fe]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w85ir95r {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:49 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w85ir95r Apr 22 08:57:49 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:50 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w85ir95r" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.828s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Uploaded volume to glance image-id: e4b39499-2fb8-413a-9890-ca452e99daed. {{(pid=83774) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.579s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Creating offline snapshot 88fc3f60-b38b-4135-b607-5d44d85091cc of volume 0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba345337-1a91-4c9b-b092-976270a89be5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:51 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-03ea0684-0296-4d07-81d2-9f6e2225b5e4 tempest-VolumesActionsTest-1062060270 None] Copy volume to image completed successfully. Apr 22 08:57:51 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 Apr 22 08:57:51 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:51 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:51 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc 1G Apr 22 08:57:51 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:52 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc 1G" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a83fa15-859b-4215-a386-2b5832c04543 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:52 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a83fa15-859b-4215-a386-2b5832c04543 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:57:52 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:52 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a83fa15-859b-4215-a386-2b5832c04543 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:52 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc is being set with open permissions: ugo+rw Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:52 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:57:52 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "cinder-quobyte-207a7992-197f-4195-90e5-5e0bbf629cd7" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Lock "cinder-quobyte-207a7992-197f-4195-90e5-5e0bbf629cd7" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[82476aee-8f4b-4d8f-8683-7b78017f5d89]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:52 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:52 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:53 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.487s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:53 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info Apr 22 08:57:53 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:53 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.512s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:53 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7 Apr 22 08:57:53 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:53 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:53 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info is being set with open permissions: ugo+rw Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:53 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info Apr 22 08:57:53 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:53 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-207a7992-197f-4195-90e5-5e0bbf629cd7" returned: 0 in 0.426s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Lock "cinder-quobyte-207a7992-197f-4195-90e5-5e0bbf629cd7" released by "delete_volume" :: held 0.957s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Created reservations ['c756aeb9-c4dc-47d6-b5d4-2fbfec960514', 'a2415063-733a-49cc-bc8e-4ba139202e3b', 'ac7f79ef-68d4-4622-ad3c-684f8df02bda', 'cf36dc0d-15ac-47ba-adf8-cfc02c0e3f99'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:53 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:57:53 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:53 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.info" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.694s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1342231396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9574821d-434c-4bc3-9b4b-fa9630a1f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88eadf05d5349eaacd7bbfd8d2390a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:43Z,use_quota=True,user_id='9da779b725bd4ddd85e4aa68fcac760f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Creating volume 9574821d-434c-4bc3-9b4b-fa9630a1f1a7 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:57:54 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:54 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 1073741824 Apr 22 08:57:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f86c9cb5-12cc-40a1-bb90-7c4d58c279b2 tempest-VolumesDeleteCascade-767543376 None] Create snapshot completed successfully Apr 22 08:57:54 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:54 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.490s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:57:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Deleted volume successfully. Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4eb84488-b28f-493a-a01e-b9766099fa45 tempest-VolumesActionsTest-1062060270 None] Lock "cinder-207a7992-197f-4195-90e5-5e0bbf629cd7-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:57:54 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 1073741824" returned: 0 in 0.535s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:54 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 Apr 22 08:57:54 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:55 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.990s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfdfa13-9b90-4ead-975d-bfcd335834a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8990f53-7282-4337-b8a4-054c139ae9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:55 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Volume volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 (9574821d-434c-4bc3-9b4b-fa9630a1f1a7): created successfully Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8990f53-7282-4337-b8a4-054c139ae9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Flow 'volume_create_manager' (0ca9301a-1b2e-4f26-81ac-e1a0b4c30855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e091d6-b6a8-476d-a9b5-593177307303]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-65e2c4ed-d8ae-41cd-8c35-0686dd3d8776 tempest-ServersNegativeTestJSON-1965105800 None] Created volume successfully. Apr 22 08:57:55 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:57:55 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:55 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 0 in 0.547s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:55 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:57:55 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:56 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 1 in 0.821s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.405s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.274s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Creating offline snapshot 13c35e67-74b8-4160-95a9-5914603c68d0 of volume 0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4', 'name': 'volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9677180b-4c32-4a96-9988-9625708b95cd', 'enforce_multipath': True} {{(pid=83774) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4eaeab-18aa-4e69-a843-bd321ca8ff2e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:56 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-a5f051f1-7872-4c56-86c1-3dca47caed24 req-508bfb14-28e7-40ad-851b-bebdb9b6a8e1 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] attachment_update completed successfully. Apr 22 08:57:56 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:57:56 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:57 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.741s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a83fa15-859b-4215-a386-2b5832c04543(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:57:57 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 1G Apr 22 08:57:57 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Flow 'volume_create_manager' (598057a7-8ed1-4c90-9520-22c8513ccc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be25349e-d80a-4b40-a52b-a37bd91795ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be25349e-d80a-4b40-a52b-a37bd91795ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1886920395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88eadf05d5349eaacd7bbfd8d2390a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:57Z,use_quota=True,user_id='9da779b725bd4ddd85e4aa68fcac760f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334d75b7-cb1b-4de6-9ae5-4b4f79c8e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334d75b7-cb1b-4de6-9ae5-4b4f79c8e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbff4fe6-bc16-4137-ad9b-1360d94fbaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbff4fe6-bc16-4137-ad9b-1360d94fbaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f', 'volume_name': 'volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b6dc1e-4473-436b-a423-ae44bc7dac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b6dc1e-4473-436b-a423-ae44bc7dac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a16eebb-ba3b-4ebf-aa12-daeb7cf855fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:57 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Volume 2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f', 'volume_size': 1} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:57 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 1G" returned: 0 in 0.563s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:57 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 Apr 22 08:57:57 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:58 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0" returned: 0 in 0.505s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:58 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 is being set with open permissions: ugo+rw Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:58 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 Apr 22 08:57:58 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Flow 'volume_create_manager' (523c097d-4f97-499c-8439-42ed2d632a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24914df7-f701-4d6c-bd06-a64f7ce347e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24914df7-f701-4d6c-bd06-a64f7ce347e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-672688832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae72f354-a543-401c-b351-77ff0bb2ec54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404c2c371c8045398ba3d405f6f653fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:58Z,use_quota=True,user_id='b700a5ee29444c7c9bed59385f2d2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1fb442-b664-42c9-809a-57bc677171f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1fb442-b664-42c9-809a-57bc677171f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35e3e55-d173-4469-b8d2-fac9f3b0fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.image.glance [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Creating Keystone auth plugin from conf {{(pid=83774) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35e3e55-d173-4469-b8d2-fac9f3b0fa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae72f354-a543-401c-b351-77ff0bb2ec54', 'volume_name': 'volume-ae72f354-a543-401c-b351-77ff0bb2ec54', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b8f4d-9786-499e-a4d0-2c95ec14c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b8f4d-9786-499e-a4d0-2c95ec14c677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088475c8-018f-4099-8c1a-94f9c49498cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:58 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Volume ae72f354-a543-401c-b351-77ff0bb2ec54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae72f354-a543-401c-b351-77ff0bb2ec54', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Trying to clone ae72f354-a543-401c-b351-77ff0bb2ec54 from image 403fb852-3ee8-4a92-abbf-1734c0db4994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]). {{(pid=83774) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 08:57:58 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1886920395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88eadf05d5349eaacd7bbfd8d2390a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:57Z,use_quota=True,user_id='9da779b725bd4ddd85e4aa68fcac760f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Creating volume 2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:57:58 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:58 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f 1073741824 Apr 22 08:57:58 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:58 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e27edcff-e484-4e3d-81aa-2cc1d14d6484 tempest-VolumesDeleteCascade-767543376 None] Create snapshot completed successfully Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 08:57:58 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Image download 20.69 MB at 20.69 MB/s Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea19ece-ea18-4e92-937e-8022a6db30a4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:59 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD Apr 22 08:57:59 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:59 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f 1073741824" returned: 0 in 0.509s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:59 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f Apr 22 08:57:59 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-0a83fa15-859b-4215-a386-2b5832c04543-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-0a83fa15-859b-4215-a386-2b5832c04543-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Performing cascade delete. {{(pid=83774) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-13c35e67-74b8-4160-95a9-5914603c68d0-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-13c35e67-74b8-4160-95a9-5914603c68d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-13c35e67-74b8-4160-95a9-5914603c68d0" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-13c35e67-74b8-4160-95a9-5914603c68d0" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Deleting offline snapshot 13c35e67-74b8-4160-95a9-5914603c68d0 of volume 0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] snapshot_file for this snap is: volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e25cd-7388-45f8-b992-a2219865c336]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:59 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 is fetched for user b700a5ee29444c7c9bed59385f2d2e70. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 08:57:59 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 Apr 22 08:57:59 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[694e889b-d701-49b7-8578-17ab1051f04c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:57:59 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD Apr 22 08:57:59 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:57:59 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a16eebb-ba3b-4ebf-aa12-daeb7cf855fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957779a3-d126-452d-bd3f-c1441537977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:57:59 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Volume volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f (2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f): created successfully Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957779a3-d126-452d-bd3f-c1441537977c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:57:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Flow 'volume_create_manager' (598057a7-8ed1-4c90-9520-22c8513ccc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:57:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6951d4e2-5ab6-4763-a21e-ed4a51aa7e0e tempest-ServersNegativeTestJSON-1965105800 None] Created volume successfully. Apr 22 08:58:00 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0" returned: 0 in 0.594s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a83fa15-859b-4215-a386-2b5832c04543(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[932af665-7ce8-4472-b07d-6dbd50b1d3dc]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:00 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-672688832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae72f354-a543-401c-b351-77ff0bb2ec54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404c2c371c8045398ba3d405f6f653fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:57:58Z,use_quota=True,user_id='b700a5ee29444c7c9bed59385f2d2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Creating volume ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:00 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:00 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 1073741824 Apr 22 08:58:00 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:00 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:58:00 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:00 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:00 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 1073741824" returned: 0 in 0.553s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.574s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a83fa15-859b-4215-a386-2b5832c04543(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:00 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 Apr 22 08:58:00 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "cinder-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:00 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:00 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "cinder-quobyte-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-quobyte-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2300c6b-6a9c-42d3-afb9-24e61347dc41]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:00 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f Apr 22 08:58:00 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:01 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Attempting download of 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume ae72f354-a543-401c-b351-77ff0bb2ec54. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a78fc0-23f5-43c2-b233-8d1bb7b16411]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:01 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h Apr 22 08:58:01 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:01 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0" returned: 0 in 0.649s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:01 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0 Apr 22 08:58:01 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:01 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f" returned: 0 in 0.582s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:01 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f Apr 22 08:58:01 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:01 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:01 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.13c35e67-74b8-4160-95a9-5914603c68d0" returned: 0 in 0.488s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h" returned: 0 in 0.607s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-13c35e67-74b8-4160-95a9-5914603c68d0" released by "_delete_snapshot" :: held 2.359s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" released by "delete_snapshot" :: held 2.371s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:01 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:01 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h Apr 22 08:58:01 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-quobyte-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f" released by "delete_volume" :: held 1.150s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:01 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Created reservations ['52a1114e-80fa-4caa-97b7-21f75f145972', '74fc88c1-3268-457d-bfa4-d05d832a9447', '6a651db5-cef4-4d11-8e7e-ea751b4816f7', 'ed98ec36-2144-4d9b-8015-8c8acdd0a4ba'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Created reservations ['f48e9309-6059-4f7b-a946-061a09e29443', '8b17215a-33c5-45c0-8094-2b639b5f2431', '4e19ce36-dd40-4604-a563-27b9c323e2ad', 'c1593fb3-e63a-4611-aed6-0c8463144075'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:02 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Delete snapshot completed successfully. Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-13c35e67-74b8-4160-95a9-5914603c68d0-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-88fc3f60-b38b-4135-b607-5d44d85091cc-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-88fc3f60-b38b-4135-b607-5d44d85091cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-88fc3f60-b38b-4135-b607-5d44d85091cc" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-88fc3f60-b38b-4135-b607-5d44d85091cc" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:02 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:02 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Deleting offline snapshot 88fc3f60-b38b-4135-b607-5d44d85091cc of volume 0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] snapshot_file for this snap is: volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[10981325-6830-4496-9854-5ea03cf9dd44]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:02 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:58:02 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:02 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h" returned: 1 in 0.598s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_4sf2pu6h' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ea65a-eb12-477f-bdcd-823478943e4c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:02 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD Apr 22 08:58:02 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "cinder-9574821d-434c-4bc3-9b4b-fa9630a1f1a7-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-9574821d-434c-4bc3-9b4b-fa9630a1f1a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:03 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.906s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Deleted volume successfully. Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "cinder-quobyte-9574821d-434c-4bc3-9b4b-fa9630a1f1a7" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-quobyte-9574821d-434c-4bc3-9b4b-fa9630a1f1a7" acquired by "delete_volume" :: waited 0.026s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:03 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32233df1-11b5-4898-baa2-ccaf2cacb346 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-2de0d4cf-3fb4-4fb1-a4e7-ef19f10e100f-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.916s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a83fa15-859b-4215-a386-2b5832c04543(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[619606e2-e5d3-47f1-bd19-418fe4aef303]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7f3da3-786e-4ca1-91aa-bdacc678329c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:03 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] 403fb852-3ee8-4a92-abbf-1734c0db4994 was qcow2, converting to raw {{(pid=83774) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:03 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 Apr 22 08:58:03 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:03 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 Apr 22 08:58:03 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:03 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:03 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:03 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7" returned: 0 in 0.607s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:03 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7 Apr 22 08:58:03 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:03 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543" returned: 0 in 0.776s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:03 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:58:03 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:04 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9574821d-434c-4bc3-9b4b-fa9630a1f1a7" returned: 0 in 0.550s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-quobyte-9574821d-434c-4bc3-9b4b-fa9630a1f1a7" released by "delete_volume" :: held 1.227s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Created reservations ['6bdd44ac-a8e1-47d6-9a0b-27053c36399c', '8a65f5ab-4031-4d64-9381-d4c38c6b5b25', '097d84c3-79b9-40c5-bba5-fcd909220689', 'ec9f74e7-d1a5-4fdf-ac71-d322f2fbc135'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:04 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 0 in 1.234s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_di0yrhxodevstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:58:04 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Converted 112.00 MB image at 90.49 MB/s Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:04 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:04 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:04 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 1G Apr 22 08:58:04 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:04 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.715s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:04 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc Apr 22 08:58:04 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:05 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 1G" returned: 0 in 0.851s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:05 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543.88fc3f60-b38b-4135-b607-5d44d85091cc" returned: 0 in 0.700s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-88fc3f60-b38b-4135-b607-5d44d85091cc" released by "_delete_snapshot" :: held 3.225s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4d1db0-1397-4ed3-892c-ed73201e1377]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" released by "delete_snapshot" :: held 3.262s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:05 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.980s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Deleted volume successfully. Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Created reservations ['794861ab-5628-4b40-8a87-db28615a2e43', 'f7ba1975-183b-4c73-a46f-21c8909a3d82', 'a2934968-304a-49eb-bd73-914b7412a1e6', '87648135-b9ab-4a01-b3ae-4431a256fb29'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b41d5d36-694a-477b-b61b-5cc8dc095a58 tempest-ServersNegativeTestJSON-1965105800 None] Lock "cinder-9574821d-434c-4bc3-9b4b-fa9630a1f1a7-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Delete snapshot completed successfully. Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-88fc3f60-b38b-4135-b607-5d44d85091cc-delete_snapshot" released by "delete_snapshot" :: held 3.425s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Snapshots deleted, issuing volume delete {{(pid=83774) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc829a-4e52-4723-b376-4a01e3319685]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:05 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:05 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:05 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 Apr 22 08:58:05 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:06 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 0 in 0.914s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:06 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543" returned: 0 in 0.806s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:06 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:06 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:06 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543 Apr 22 08:58:06 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:07 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0a83fa15-859b-4215-a386-2b5832c04543" returned: 0 in 0.656s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-0a83fa15-859b-4215-a386-2b5832c04543" released by "delete_volume" :: held 1.531s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:07 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Created reservations ['af4454cc-0add-4715-8e92-08222a75f3a4', '79edbc25-2661-40f7-8ca3-770cc7e2598f', 'af4c968d-45d3-4427-8e04-b78ed0ec6f80', '2b42a0c1-9bd3-49cb-bda7-775fa60a58ea'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 1 in 0.872s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Downloaded image 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume ae72f354-a543-401c-b351-77ff0bb2ec54 successfully. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 for user b700a5ee29444c7c9bed59385f2d2e70 is deleted. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Marking volume ae72f354-a543-401c-b351-77ff0bb2ec54 as bootable. {{(pid=83774) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Copying metadata from image 403fb852-3ee8-4a92-abbf-1734c0db4994 to ae72f354-a543-401c-b351-77ff0bb2ec54. {{(pid=83774) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Creating volume glance metadata for volume ae72f354-a543-401c-b351-77ff0bb2ec54 backed by image 403fb852-3ee8-4a92-abbf-1734c0db4994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83774) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088475c8-018f-4099-8c1a-94f9c49498cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae72f354-a543-401c-b351-77ff0bb2ec54', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d350642-2f17-4508-abb1-bdc906328421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:07 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Volume volume-ae72f354-a543-401c-b351-77ff0bb2ec54 (ae72f354-a543-401c-b351-77ff0bb2ec54): created successfully Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d350642-2f17-4508-abb1-bdc906328421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:07 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:07 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Flow 'volume_create_manager' (523c097d-4f97-499c-8439-42ed2d632a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-fb08aed7-ed16-49bd-aa14-15d937b04fbb tempest-VolumesExtendTest-1039175107 None] Created volume successfully. Apr 22 08:58:07 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.501s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Deleted volume successfully. Apr 22 08:58:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6ef8ac4a-da2d-498f-8c3a-f76397d15a24 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-0a83fa15-859b-4215-a386-2b5832c04543-delete_volume" released by "delete_volume" :: held 8.341s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec12b551-9f6f-4d2d-bcbb-20871e184150]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:08 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:08 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Flow 'volume_create_manager' (c30cd453-d3ba-49ca-9820-9f5c43e901bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963c1a1a-5124-4eae-b716-c46c8feb4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963c1a1a-5124-4eae-b716-c46c8feb4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-979093470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99763667-823f-4157-9d26-9a65bd5d4365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bac46f4844505910fbd6343d10228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:09Z,use_quota=True,user_id='f22b4352e65c4ed482b8a0b93eed3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae966709-bd5f-4f03-8566-274816a5535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae966709-bd5f-4f03-8566-274816a5535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca702ae-15a3-4dd9-8083-48db0ed97523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca702ae-15a3-4dd9-8083-48db0ed97523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99763667-823f-4157-9d26-9a65bd5d4365', 'volume_name': 'volume-99763667-823f-4157-9d26-9a65bd5d4365', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac87bd1e-6e21-437f-ac21-47a1f072f158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac87bd1e-6e21-437f-ac21-47a1f072f158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7655e69e-47f9-4ba5-98cf-68eb19365527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:08 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Volume 99763667-823f-4157-9d26-9a65bd5d4365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99763667-823f-4157-9d26-9a65bd5d4365', 'volume_size': 1} Apr 22 08:58:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:09 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 0 in 0.647s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:09 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:09 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:09 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 1 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 2G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 2G" returned: 0 in 0.058s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.257s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-979093470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99763667-823f-4157-9d26-9a65bd5d4365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bac46f4844505910fbd6343d10228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:09Z,use_quota=True,user_id='f22b4352e65c4ed482b8a0b93eed3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Creating volume 99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:09 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:09 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 1073741824 Apr 22 08:58:09 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-97a1597f-905a-43ff-b1a5-9be84aa86f83 tempest-VolumesExtendTest-1039175107 None] Extend volume completed successfully. Apr 22 08:58:10 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 1073741824" returned: 0 in 0.629s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:10 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:10 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-ae72f354-a543-401c-b351-77ff0bb2ec54-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Lock "cinder-ae72f354-a543-401c-b351-77ff0bb2ec54-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-quobyte-ae72f354-a543-401c-b351-77ff0bb2ec54" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-ae72f354-a543-401c-b351-77ff0bb2ec54" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300af00-51b4-4f9f-9903-350a10db6e0f]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:10 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.477s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7655e69e-47f9-4ba5-98cf-68eb19365527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99763667-823f-4157-9d26-9a65bd5d4365', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe9165e-922e-4d75-8940-dce0448bf9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:10 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Volume volume-99763667-823f-4157-9d26-9a65bd5d4365 (99763667-823f-4157-9d26-9a65bd5d4365): created successfully Apr 22 08:58:10 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:10 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe9165e-922e-4d75-8940-dce0448bf9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Flow 'volume_create_manager' (c30cd453-d3ba-49ca-9820-9f5c43e901bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3567621e-b825-46ec-993c-3c841868b42c tempest-VolumesDeleteCascade-767543376 None] Created volume successfully. Apr 22 08:58:11 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 0 in 0.533s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:11 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:11 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:11 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 1 in 0.563s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:58:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:11 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54 Apr 22 08:58:11 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Creating offline snapshot 7814189b-8fa9-4afd-b201-a40b9e22eb8f of volume 99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae3182-b029-40c7-98a8-76f20f5db911]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:12 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:12 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:12 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ae72f354-a543-401c-b351-77ff0bb2ec54" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-ae72f354-a543-401c-b351-77ff0bb2ec54" released by "delete_volume" :: held 1.573s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Created reservations ['dd343b38-472b-4a1d-b63d-59b915368fe0', 'f9196591-84c9-4841-bd81-d5474c136123', '3e1991c4-f208-400d-b30c-aba1969d3046', 'bd7d97b3-fc84-494f-ac4b-e24e40dc9cd2'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:12 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:12 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:12 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:12 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f 1G Apr 22 08:58:12 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:12 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Deleted volume successfully. Apr 22 08:58:12 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:12 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f9937fdc-89ee-489c-af7a-970c2a81813c tempest-VolumesExtendTest-1039175107 None] Lock "cinder-ae72f354-a543-401c-b351-77ff0bb2ec54-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:13 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f 1G" returned: 0 in 0.576s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99763667-823f-4157-9d26-9a65bd5d4365 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:13 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99763667-823f-4157-9d26-9a65bd5d4365 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f Apr 22 08:58:13 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Flow 'volume_create_manager' (fd655b94-11b4-4ac4-9b6f-2965ede8e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882ee157-530c-493f-ad6f-36daa44587f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882ee157-530c-493f-ad6f-36daa44587f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1921730024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332b64c8-5dd2-4136-a968-027546ba573a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404c2c371c8045398ba3d405f6f653fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:13Z,use_quota=True,user_id='b700a5ee29444c7c9bed59385f2d2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba802c68-3337-490a-b15c-20400bdd6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba802c68-3337-490a-b15c-20400bdd6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f01c3e3-b84d-4e20-b748-c053d501ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f01c3e3-b84d-4e20-b748-c053d501ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332b64c8-5dd2-4136-a968-027546ba573a', 'volume_name': 'volume-332b64c8-5dd2-4136-a968-027546ba573a', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70740f5f-6160-42f4-934a-7764682be7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70740f5f-6160-42f4-934a-7764682be7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289fd502-641c-4aea-ac5d-c8b16113efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:13 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Volume 332b64c8-5dd2-4136-a968-027546ba573a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332b64c8-5dd2-4136-a968-027546ba573a', 'volume_size': 1} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:13 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.546s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:13 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99763667-823f-4157-9d26-9a65bd5d4365 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f" returned: 0 in 0.513s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:13 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f is being set with open permissions: ugo+rw Apr 22 08:58:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:13 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f Apr 22 08:58:13 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:14 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f" returned: 0 in 0.493s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:14 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info Apr 22 08:58:14 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:14 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info" returned: 0 in 0.440s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:14 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info is being set with open permissions: ugo+rw Apr 22 08:58:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:14 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info Apr 22 08:58:14 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:15 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.info" returned: 0 in 0.478s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.051s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1921730024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332b64c8-5dd2-4136-a968-027546ba573a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404c2c371c8045398ba3d405f6f653fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:13Z,use_quota=True,user_id='b700a5ee29444c7c9bed59385f2d2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Creating volume 332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:15 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:15 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a 1073741824 Apr 22 08:58:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7280ff86-46ed-4097-af88-e0554844cae1 tempest-VolumesDeleteCascade-767543376 None] Create snapshot completed successfully Apr 22 08:58:15 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:15 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a 1073741824" returned: 0 in 0.593s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:15 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a Apr 22 08:58:15 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:16 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a" returned: 0 in 0.525s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289fd502-641c-4aea-ac5d-c8b16113efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332b64c8-5dd2-4136-a968-027546ba573a', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271bf6ac-adcb-427b-9a5b-f0445471616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:16 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Volume volume-332b64c8-5dd2-4136-a968-027546ba573a (332b64c8-5dd2-4136-a968-027546ba573a): created successfully Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271bf6ac-adcb-427b-9a5b-f0445471616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Flow 'volume_create_manager' (fd655b94-11b4-4ac4-9b6f-2965ede8e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:16 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6c175d0d-41d1-413b-b743-e55bc0243f84 tempest-VolumesExtendTest-1039175107 None] Created volume successfully. Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Flow 'volume_create_manager' (a4a6e709-7b5c-4632-95ef-2ee2ffa94807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d0484-9216-4d78-b6bb-fe0e281f9013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d0484-9216-4d78-b6bb-fe0e281f9013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2026190128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e521f5-9b77-4c0e-a082-25daa8eb2fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772bac46f4844505910fbd6343d10228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7814189b-8fa9-4afd-b201-a40b9e22eb8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:17Z,use_quota=True,user_id='f22b4352e65c4ed482b8a0b93eed3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14920c5-f233-4741-9b22-f6b4210f80f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14920c5-f233-4741-9b22-f6b4210f80f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da33cc46-dc24-4622-b29c-fcfc6d6227f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da33cc46-dc24-4622-b29c-fcfc6d6227f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03e521f5-9b77-4c0e-a082-25daa8eb2fea', 'volume_name': 'volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea', 'volume_size': 1, 'snapshot_id': '7814189b-8fa9-4afd-b201-a40b9e22eb8f'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679c0fdc-ff14-453a-8972-1009a217f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679c0fdc-ff14-453a-8972-1009a217f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02858a2-8a7e-44fa-b7f1-91dd10a300f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:16 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Volume 03e521f5-9b77-4c0e-a082-25daa8eb2fea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea', 'volume_size': 1, 'snapshot_id': '7814189b-8fa9-4afd-b201-a40b9e22eb8f'} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-7814189b-8fa9-4afd-b201-a40b9e22eb8f-03e521f5-9b77-4c0e-a082-25daa8eb2fea" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-7814189b-8fa9-4afd-b201-a40b9e22eb8f-03e521f5-9b77-4c0e-a082-25daa8eb2fea" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Creating volume 03e521f5-9b77-4c0e-a082-25daa8eb2fea from snapshot 7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-03e521f5-9b77-4c0e-a082-25daa8eb2fea" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-03e521f5-9b77-4c0e-a082-25daa8eb2fea" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] snapshot: 7814189b-8fa9-4afd-b201-a40b9e22eb8f, volume: 03e521f5-9b77-4c0e-a082-25daa8eb2fea, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbfd38e-c7f6-410a-a40a-10555b13d0a6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:16 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f Apr 22 08:58:16 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:17 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99763667-823f-4157-9d26-9a65bd5d4365(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[55536ee5-f713-4c97-b687-5937455b1e09]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:17 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:17 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:18 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Flow 'volume_create_manager' (69fef52c-3961-4c2b-bb09-7953eaf26602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ef1c06-d705-468b-86ca-a4c30e2e5617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.953s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:18 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ef1c06-d705-468b-86ca-a4c30e2e5617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1512738172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfc5b44-929a-41e2-955f-49809b24b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea30262213142cea76cc21fc9020f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:18Z,use_quota=True,user_id='ec54483d30024fcf926a9921c56b90fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:18 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c77b9d-ed87-4a92-839c-55ce3b0373df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c77b9d-ed87-4a92-839c-55ce3b0373df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b970a5f-497a-4aa5-ad62-dedf35820783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b970a5f-497a-4aa5-ad62-dedf35820783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bfc5b44-929a-41e2-955f-49809b24b642', 'volume_name': 'volume-0bfc5b44-929a-41e2-955f-49809b24b642', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8593839e-5c6a-4346-9660-a2d87d3705d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8593839e-5c6a-4346-9660-a2d87d3705d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a87f524-dbdf-4c21-87d4-3c315c4ad970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:18 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Volume 0bfc5b44-929a-41e2-955f-49809b24b642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bfc5b44-929a-41e2-955f-49809b24b642', 'volume_size': 1} Apr 22 08:58:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:20 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea" returned: 0 in 2.564s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:20 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2997d52c-1d0e-4f7e-9e6a-bfa1f8386262]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:20 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:20 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:21 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.628s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:58:21 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Converted 1024.00 MB image at 399.20 MB/s Apr 22 08:58:21 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea is being set with open permissions: ugo+rw Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:21 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea Apr 22 08:58:21 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:21 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea" returned: 0 in 0.457s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-03e521f5-9b77-4c0e-a082-25daa8eb2fea" released by "_copy_volume_from_snapshot" :: held 5.195s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-7814189b-8fa9-4afd-b201-a40b9e22eb8f-03e521f5-9b77-4c0e-a082-25daa8eb2fea" released by "_create_volume_from_snapshot" :: held 5.220s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.228s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.032s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02858a2-8a7e-44fa-b7f1-91dd10a300f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea', 'volume_size': 1, 'snapshot_id': '7814189b-8fa9-4afd-b201-a40b9e22eb8f'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cea46b9-050c-48e0-9c96-da7299342efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Creating offline snapshot e541028e-47be-4d9f-9e5f-3cea9fc59d0d of volume 332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:58:22 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Volume volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea (03e521f5-9b77-4c0e-a082-25daa8eb2fea): created successfully Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cea46b9-050c-48e0-9c96-da7299342efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Flow 'volume_create_manager' (a4a6e709-7b5c-4632-95ef-2ee2ffa94807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c382a88-c519-4f6b-9a12-d64d3e3206b7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:22 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-31de141a-6dd1-4cb7-ad0b-b9b3ca93f287 tempest-VolumesDeleteCascade-767543376 None] Created volume successfully. Apr 22 08:58:22 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a Apr 22 08:58:22 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:22 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a" returned: 0 in 0.589s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:22 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d 1G Apr 22 08:58:22 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-99763667-823f-4157-9d26-9a65bd5d4365-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-99763667-823f-4157-9d26-9a65bd5d4365-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:23 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d 1G" returned: 0 in 0.517s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332b64c8-5dd2-4136-a968-027546ba573a -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:23 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332b64c8-5dd2-4136-a968-027546ba573a -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d Apr 22 08:58:23 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Performing cascade delete. {{(pid=83774) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-7814189b-8fa9-4afd-b201-a40b9e22eb8f-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-7814189b-8fa9-4afd-b201-a40b9e22eb8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-99763667-823f-4157-9d26-9a65bd5d4365" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-99763667-823f-4157-9d26-9a65bd5d4365" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-7814189b-8fa9-4afd-b201-a40b9e22eb8f" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-7814189b-8fa9-4afd-b201-a40b9e22eb8f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Deleting offline snapshot 7814189b-8fa9-4afd-b201-a40b9e22eb8f of volume 99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] snapshot_file for this snap is: volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[df43c92d-c763-45e3-98f9-4419516b20b6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:23 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f Apr 22 08:58:23 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:23 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332b64c8-5dd2-4136-a968-027546ba573a -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:23 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d is being set with open permissions: ugo+rw Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:23 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d Apr 22 08:58:23 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:23 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f" returned: 0 in 0.491s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99763667-823f-4157-9d26-9a65bd5d4365(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4885d31e-7bab-4625-a64f-174e288869fb]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:23 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:23 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:24 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:24 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info Apr 22 08:58:24 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:24 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.683s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:24 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f Apr 22 08:58:24 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:24 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info" returned: 0 in 0.548s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:24 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info is being set with open permissions: ugo+rw Apr 22 08:58:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:24 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info Apr 22 08:58:24 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:25 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f" returned: 0 in 0.584s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:25 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f Apr 22 08:58:25 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:25 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.info" returned: 0 in 0.503s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.250s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.893s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1512738172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfc5b44-929a-41e2-955f-49809b24b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea30262213142cea76cc21fc9020f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:18Z,use_quota=True,user_id='ec54483d30024fcf926a9921c56b90fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Creating volume 0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:25 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:25 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 1073741824 Apr 22 08:58:25 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:25 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f528705f-0add-4277-9ad2-779b89ef637b tempest-VolumesExtendTest-1039175107 None] Create snapshot completed successfully Apr 22 08:58:25 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365.7814189b-8fa9-4afd-b201-a40b9e22eb8f" returned: 0 in 0.537s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-7814189b-8fa9-4afd-b201-a40b9e22eb8f" released by "_delete_snapshot" :: held 2.372s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-99763667-823f-4157-9d26-9a65bd5d4365" released by "delete_snapshot" :: held 2.383s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Created reservations ['388998d2-1da6-4fab-a6ec-9750d0376dbf', 'cdc35ba7-7e54-4ea6-ae43-3d14d2944b64', '3674afe6-8562-4585-8c6b-82f200b3ff1f', 'e8680e84-dab9-467c-b9aa-a16288b519a4'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:25 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Delete snapshot completed successfully. Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-7814189b-8fa9-4afd-b201-a40b9e22eb8f-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Snapshots deleted, issuing volume delete {{(pid=83774) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-99763667-823f-4157-9d26-9a65bd5d4365" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-99763667-823f-4157-9d26-9a65bd5d4365" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[88544689-78c5-4be2-992b-46e192a3cbe8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:25 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:25 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:25 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 1073741824" returned: 0 in 0.696s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:26 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 Apr 22 08:58:26 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:26 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.630s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:26 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365 Apr 22 08:58:26 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:26 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642" returned: 0 in 0.718s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.247s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a87f524-dbdf-4c21-87d4-3c315c4ad970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfc5b44-929a-41e2-955f-49809b24b642', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e3575e-ee75-4b94-a3e8-bf6eb120e17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[137ed2aa-bd42-413a-bf1b-340c1bf927fc]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:26 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Volume volume-0bfc5b44-929a-41e2-955f-49809b24b642 (0bfc5b44-929a-41e2-955f-49809b24b642): created successfully Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e3575e-ee75-4b94-a3e8-bf6eb120e17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:26 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Flow 'volume_create_manager' (69fef52c-3961-4c2b-bb09-7953eaf26602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:26 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-533bc044-4fff-44c8-a599-b679ea3dd61f req-fee5e309-1b1d-42e3-9575-9bfb7bb64d60 tempest-VolumesSnapshotsTestJSON-155839313 None] Created volume successfully. Apr 22 08:58:26 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a Apr 22 08:58:26 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:27 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99763667-823f-4157-9d26-9a65bd5d4365" returned: 0 in 0.701s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-99763667-823f-4157-9d26-9a65bd5d4365" released by "delete_volume" :: held 1.385s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Created reservations ['16c7d973-dcba-4770-850e-e07c183620d2', 'e6a31c55-772f-4aa9-b1a8-967314e6d265', '035aa983-4b3d-4791-bc8f-81143f943eba', '2e9cfeac-672a-4abb-8fe2-bfdee26ca042'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:27 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:27 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:27 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a" returned: 0 in 0.755s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d 2G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d 2G" returned: 0 in 0.080s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.869s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.179s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Creating offline snapshot 416b49f7-62e3-457f-adc8-bd1b9c860fc2 of volume 0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[35701be8-2d84-4e4b-8ec8-c821d98b39cb]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-03e521f5-9b77-4c0e-a082-25daa8eb2fea-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:27 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9c437313-ae34-4fab-bc33-0bca115643ce tempest-VolumesExtendTest-1039175107 None] Extend volume completed successfully. Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-03e521f5-9b77-4c0e-a082-25daa8eb2fea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:INSERT=37,cinder:UPDATE=111,cinder:SELECT=125,cinder:DELETE=5 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "cinder-quobyte-03e521f5-9b77-4c0e-a082-25daa8eb2fea" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-03e521f5-9b77-4c0e-a082-25daa8eb2fea" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:27 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 Apr 22 08:58:27 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7bf04f-8fff-4681-9e96-1430b14022bb]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:27 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.562s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:27 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Deleted volume successfully. Apr 22 08:58:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f62a58d-2608-4d94-8624-7f770d51c3be tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-99763667-823f-4157-9d26-9a65bd5d4365-delete_volume" released by "delete_volume" :: held 4.650s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:27 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea Apr 22 08:58:27 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:28 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea" returned: 0 in 0.605s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:28 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea Apr 22 08:58:28 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:28 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642" returned: 0 in 0.772s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:28 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 1G Apr 22 08:58:28 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-e541028e-47be-4d9f-9e5f-3cea9fc59d0d-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-e541028e-47be-4d9f-9e5f-3cea9fc59d0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-quobyte-332b64c8-5dd2-4136-a968-027546ba573a" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-332b64c8-5dd2-4136-a968-027546ba573a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-quobyte-e541028e-47be-4d9f-9e5f-3cea9fc59d0d" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-e541028e-47be-4d9f-9e5f-3cea9fc59d0d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Deleting offline snapshot e541028e-47be-4d9f-9e5f-3cea9fc59d0d of volume 332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] snapshot_file for this snap is: volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402cf15-3a18-401d-81d3-a245aea1bd0f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:28 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03e521f5-9b77-4c0e-a082-25daa8eb2fea" returned: 0 in 0.499s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-quobyte-03e521f5-9b77-4c0e-a082-25daa8eb2fea" released by "delete_volume" :: held 1.127s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:28 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d Apr 22 08:58:28 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Created reservations ['6bb46f2f-b39f-427d-af42-1eaaa16bc577', '1b916abd-90f6-43c9-9afa-8e03e7b32dbe', '2a726670-da92-40dd-9f11-f079996245c8', '2b2636de-1852-4806-8318-edc251b435c4'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:28 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 1G" returned: 0 in 0.533s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfc5b44-929a-41e2-955f-49809b24b642 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:28 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfc5b44-929a-41e2-955f-49809b24b642 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 Apr 22 08:58:28 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:28 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:28 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:29 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-332b64c8-5dd2-4136-a968-027546ba573a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b722920-8db4-4f22-b4a5-4686cb07e65a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:29 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfc5b44-929a-41e2-955f-49809b24b642 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:29 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 is being set with open permissions: ugo+rw Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:29 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:29 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 Apr 22 08:58:29 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:29 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Deleted volume successfully. Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-11505bc8-92c5-44c7-a3aa-33d93d7f459b tempest-VolumesDeleteCascade-767543376 None] Lock "cinder-03e521f5-9b77-4c0e-a082-25daa8eb2fea-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:29 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a Apr 22 08:58:29 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:29 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a" returned: 0 in 0.582s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:29 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2" returned: 0 in 0.561s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:29 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d Apr 22 08:58:29 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:29 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info Apr 22 08:58:29 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:30 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:30 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info is being set with open permissions: ugo+rw Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:30 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info Apr 22 08:58:30 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:30 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d" returned: 0 in 0.551s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:30 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d Apr 22 08:58:30 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:30 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-b8389b50-9a2f-40de-973c-928d40b092d4 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Terminate volume connection completed successfully. Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-b8389b50-9a2f-40de-973c-928d40b092d4 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Deleting attachment 9677180b-4c32-4a96-9988-9625708b95cd. {{(pid=83774) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 22 08:58:30 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.info" returned: 0 in 0.570s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:31 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-fbbcd35a-bf82-4ada-a614-eaf12d887bf8 req-04600ca8-2322-44a5-b09a-7f35080c15cd tempest-VolumesSnapshotsTestJSON-155839313 None] Create snapshot completed successfully Apr 22 08:58:31 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a.e541028e-47be-4d9f-9e5f-3cea9fc59d0d" returned: 0 in 0.597s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-e541028e-47be-4d9f-9e5f-3cea9fc59d0d" released by "_delete_snapshot" :: held 2.309s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-332b64c8-5dd2-4136-a968-027546ba573a" released by "delete_snapshot" :: held 2.324s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Created reservations ['070dd181-e927-4545-9a87-16431ea7c40f', '04da4682-3c1f-4ddc-8003-88d396ac7c69', 'b64facc2-19dc-4f2c-a9c6-4a302bbcfc82', '29461c80-f925-4966-8dca-10cba928bffe'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:31 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Delete snapshot completed successfully. Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4b09a916-cae0-48c5-8f5f-525eba0a72d3 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-e541028e-47be-4d9f-9e5f-3cea9fc59d0d-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "cinder-fdf10e37-8ff4-4a84-b09d-ee4630a9c336-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-fdf10e37-8ff4-4a84-b09d-ee4630a9c336-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "cinder-quobyte-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-quobyte-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de8e77-864a-418a-a697-1a3146f7a171]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:31 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:58:31 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "cinder-416b49f7-62e3-457f-adc8-bd1b9c860fc2-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-416b49f7-62e3-457f-adc8-bd1b9c860fc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "cinder-quobyte-0bfc5b44-929a-41e2-955f-49809b24b642" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-quobyte-0bfc5b44-929a-41e2-955f-49809b24b642" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "cinder-quobyte-416b49f7-62e3-457f-adc8-bd1b9c860fc2" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-quobyte-416b49f7-62e3-457f-adc8-bd1b9c860fc2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Deleting offline snapshot 416b49f7-62e3-457f-adc8-bd1b9c860fc2 of volume 0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] snapshot_file for this snap is: volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e7b80-dece-47a5-9c87-1acd15f78b1f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:31 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 Apr 22 08:58:31 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-332b64c8-5dd2-4136-a968-027546ba573a-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-332b64c8-5dd2-4136-a968-027546ba573a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "cinder-quobyte-332b64c8-5dd2-4136-a968-027546ba573a" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-332b64c8-5dd2-4136-a968-027546ba573a" acquired by "delete_volume" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[72583282-00f6-4ce7-9f31-1ff102080e60]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:32 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a Apr 22 08:58:32 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:32 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 0 in 0.657s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:32 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:58:32 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:32 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2" returned: 0 in 0.611s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bfc5b44-929a-41e2-955f-49809b24b642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[456fea70-39fd-4244-82c1-cb56c8ab89c4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:32 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 Apr 22 08:58:32 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:32 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a" returned: 0 in 0.600s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:32 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 1 in 0.520s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:32 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a Apr 22 08:58:32 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:32 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336 Apr 22 08:58:32 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:32 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Flow 'volume_create_manager' (8216e5a1-198c-477e-8370-afe94f204b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79d85c4-9a5c-4869-b4e3-19fe643248f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79d85c4-9a5c-4869-b4e3-19fe643248f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-903814618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c09adf5-eeea-4fac-99f7-9c5f468fd8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c257ffcf95433590ab5217fced147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:33Z,use_quota=True,user_id='6dd65367ee7843abbc406f878214c137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307c00a8-4e16-4b7a-9a97-037bd1e7096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307c00a8-4e16-4b7a-9a97-037bd1e7096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19283ea-e91d-4e2c-8c3d-69ddec1ec137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19283ea-e91d-4e2c-8c3d-69ddec1ec137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c09adf5-eeea-4fac-99f7-9c5f468fd8fd', 'volume_name': 'volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae446b-3832-4b57-9c5b-b0c6f76e4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae446b-3832-4b57-9c5b-b0c6f76e4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b28d42d-b387-4c3f-b8a8-ddbd325bd15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Volume 7c09adf5-eeea-4fac-99f7-9c5f468fd8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd', 'volume_size': 1} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-903814618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c09adf5-eeea-4fac-99f7-9c5f468fd8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c257ffcf95433590ab5217fced147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:33Z,use_quota=True,user_id='6dd65367ee7843abbc406f878214c137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Creating volume 7c09adf5-eeea-4fac-99f7-9c5f468fd8fd {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:33 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:33 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd 1073741824 Apr 22 08:58:33 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:33 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642" returned: 0 in 0.726s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:33 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 Apr 22 08:58:33 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:33 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-332b64c8-5dd2-4136-a968-027546ba573a" returned: 0 in 0.534s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-quobyte-332b64c8-5dd2-4136-a968-027546ba573a" released by "delete_volume" :: held 1.179s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Created reservations ['8627ac4f-735b-4bbd-8764-1a48880f77de', '4f49d19c-3dcd-4753-a0a8-18d5e8555a8c', 'd668e908-c719-446c-a973-763c0b97eda9', '91bf81e1-52a8-40b1-a523-077aa7b7c9c9'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:33 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" returned: 0 in 0.622s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-quobyte-fdf10e37-8ff4-4a84-b09d-ee4630a9c336" released by "delete_volume" :: held 1.851s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:33 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:33 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.quota [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Created reservations ['7382677a-2836-40cd-83a4-b3ccb3a3cb8c', 'ac04a212-951a-47d6-b84f-f9fa95ae956d', 'd2b7cbf1-b97b-471e-b450-4ee7c20218a0', '7106b6de-2ec8-4aec-8cd4-189c20375007'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:33 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:33 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:33 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd 1073741824" returned: 0 in 0.503s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:33 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd Apr 22 08:58:33 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:33 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2" returned: 0 in 0.581s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:33 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2 Apr 22 08:58:33 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:33 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.491s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Deleted volume successfully. Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75863d22-b214-4a40-aeae-c370e770c094 tempest-VolumesExtendTest-1039175107 None] Lock "cinder-332b64c8-5dd2-4136-a968-027546ba573a-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:33 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.manager [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Deleted volume successfully. Apr 22 08:58:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-e88fdb02-3fa6-435b-aaac-763c186783bb req-55a3be54-2a16-44c2-9e44-2531b4c1a98d tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-fdf10e37-8ff4-4a84-b09d-ee4630a9c336-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:34 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd" returned: 0 in 0.532s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b28d42d-b387-4c3f-b8a8-ddbd325bd15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:34 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaf085a-f06c-42ea-8e6c-ea22deebd2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642.416b49f7-62e3-457f-adc8-bd1b9c860fc2" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Volume volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd (7c09adf5-eeea-4fac-99f7-9c5f468fd8fd): created successfully Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaf085a-f06c-42ea-8e6c-ea22deebd2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Flow 'volume_create_manager' (8216e5a1-198c-477e-8370-afe94f204b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-47a106ca-7755-4661-8946-32f9c21c510b tempest-VolumesTransfersTest-111570047 None] Created volume successfully. Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-quobyte-416b49f7-62e3-457f-adc8-bd1b9c860fc2" released by "_delete_snapshot" :: held 2.448s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-quobyte-0bfc5b44-929a-41e2-955f-49809b24b642" released by "delete_snapshot" :: held 2.474s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.quota [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Created reservations ['37b20ed5-c7c8-4148-b259-7686e67d165f', '4f2e9a49-4161-4fc9-8f81-05109c4f0846', 'f7239c94-a02f-4e0f-b620-9c4a1aa98a98', 'e4c5f05c-d2e0-4664-be7e-3f9870facee2'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Delete snapshot completed successfully. Apr 22 08:58:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-372d0296-0cbc-42a3-b736-6cc9127b3591 req-134e280b-0190-4ab4-accf-92fc723b210c tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-416b49f7-62e3-457f-adc8-bd1b9c860fc2-delete_snapshot" released by "delete_snapshot" :: held 2.553s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "cinder-0bfc5b44-929a-41e2-955f-49809b24b642-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-0bfc5b44-929a-41e2-955f-49809b24b642-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "cinder-quobyte-0bfc5b44-929a-41e2-955f-49809b24b642" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-quobyte-0bfc5b44-929a-41e2-955f-49809b24b642" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3978b56c-6207-445b-8a0b-31fbc09363eb]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:35 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 Apr 22 08:58:35 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-aebb1220-942a-4b0c-8235-53049c5dbb8a tempest-VolumesTransfersTest-1000704507 None] Transfer volume completed successfully. Apr 22 08:58:35 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642" returned: 0 in 0.810s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:35 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642 Apr 22 08:58:35 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:36 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0bfc5b44-929a-41e2-955f-49809b24b642" returned: 0 in 0.515s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-quobyte-0bfc5b44-929a-41e2-955f-49809b24b642" released by "delete_volume" :: held 1.355s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.quota [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Created reservations ['f78aa73a-20da-4c38-9837-e4ae1641f13f', '01a3aad2-d83d-4e3c-b9c4-19163ca0ecb6', 'ded5768e-5421-470d-b3d3-b5d78c34c503', 'ddcfee49-2228-48a3-b362-34a5a171bd0c'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:36 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:36 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Acquiring lock "cinder-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Acquiring lock "cinder-quobyte-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-quobyte-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[330e3c86-540a-4515-8a27-853c3389db69]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:36 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd Apr 22 08:58:36 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:37 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG cinder.manager [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Deleted volume successfully. Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f686806-d2eb-4f8b-aacd-fb39eeff2397 req-8c2dc450-6afa-4c7f-b225-9bb78e33a9eb tempest-VolumesSnapshotsTestJSON-155839313 None] Lock "cinder-0bfc5b44-929a-41e2-955f-49809b24b642-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:37 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd" returned: 0 in 0.687s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:37 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd Apr 22 08:58:37 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:37 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd" returned: 0 in 0.479s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-quobyte-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd" released by "delete_volume" :: held 1.188s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Created reservations ['810f9207-a3de-4ba8-9a7a-0598a537a178', 'e64af19b-8520-4b45-b743-82649a913b5f', '5999a8cb-4f5d-4d8f-9fb8-606207646e74', '2b1e3433-d79e-403c-b17e-54dcb6d4a11f'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:38 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:38 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=120,cinder:UPDATE=162,cinder:INSERT=46,cinder:DELETE=16 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Flow 'volume_create_manager' (e51c8523-0d9b-4e47-988d-871b3de7a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf7b66a-d3c4-401e-89eb-5a4fa3b378c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf7b66a-d3c4-401e-89eb-5a4fa3b378c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1533608703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd0eeee-6ed4-49f8-9363-701751ece2b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdf73b2d69a4ce6a2993b0f61113807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:38Z,use_quota=True,user_id='d087576a252d43d5bcf04362461b3db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c41058d-46ec-4899-b379-3e808da24a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c41058d-46ec-4899-b379-3e808da24a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f8a947-07d1-4788-a19b-8cb365e5657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f8a947-07d1-4788-a19b-8cb365e5657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd0eeee-6ed4-49f8-9363-701751ece2b9', 'volume_name': 'volume-afd0eeee-6ed4-49f8-9363-701751ece2b9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52440289-e131-4408-8932-9c507215fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52440289-e131-4408-8932-9c507215fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dcd544-f1cf-4c5c-837e-d832fed56ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:38 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Volume afd0eeee-6ed4-49f8-9363-701751ece2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd0eeee-6ed4-49f8-9363-701751ece2b9', 'volume_size': 1} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1533608703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd0eeee-6ed4-49f8-9363-701751ece2b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdf73b2d69a4ce6a2993b0f61113807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:38Z,use_quota=True,user_id='d087576a252d43d5bcf04362461b3db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Creating volume afd0eeee-6ed4-49f8-9363-701751ece2b9 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:38 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:38 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 1073741824 Apr 22 08:58:38 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:38 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.594s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Deleted volume successfully. Apr 22 08:58:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d553d5fd-3f33-4045-89c2-49636e2388d6 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-7c09adf5-eeea-4fac-99f7-9c5f468fd8fd-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 1073741824" returned: 0 in 0.622s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:39 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:39 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 Apr 22 08:58:39 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Flow 'volume_create_manager' (359d57d2-1176-47ca-8344-17abac2e9e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3635874-54bd-4efa-9b20-0493ef1472dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3635874-54bd-4efa-9b20-0493ef1472dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-30657973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8e1af1-82de-4c48-8f8a-f27683e7f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c257ffcf95433590ab5217fced147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:39Z,use_quota=True,user_id='6dd65367ee7843abbc406f878214c137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfb91fc-ee4d-4287-98be-c433517d4b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfb91fc-ee4d-4287-98be-c433517d4b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b13b794-9d6a-4c59-8db8-2361208bc3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b13b794-9d6a-4c59-8db8-2361208bc3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8e1af1-82de-4c48-8f8a-f27683e7f6b2', 'volume_name': 'volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1b93e8-e208-4530-b8a2-e71ba844e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1b93e8-e208-4530-b8a2-e71ba844e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ec5de4-c7fe-4425-bfef-809efb184aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:39 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Volume 7b8e1af1-82de-4c48-8f8a-f27683e7f6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2', 'volume_size': 1} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:39 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-30657973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8e1af1-82de-4c48-8f8a-f27683e7f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c257ffcf95433590ab5217fced147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:39Z,use_quota=True,user_id='6dd65367ee7843abbc406f878214c137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Creating volume 7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:39 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dcd544-f1cf-4c5c-837e-d832fed56ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd0eeee-6ed4-49f8-9363-701751ece2b9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aff9279-ee1e-41a9-8d80-fe80a8038aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:39 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 1073741824 Apr 22 08:58:39 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:39 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Volume volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 (afd0eeee-6ed4-49f8-9363-701751ece2b9): created successfully Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aff9279-ee1e-41a9-8d80-fe80a8038aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Flow 'volume_create_manager' (e51c8523-0d9b-4e47-988d-871b3de7a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-325cafab-8380-4c34-bbeb-97f331ff4372 tempest-VolumesListTestJSON-845429107 None] Created volume successfully. Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Flow 'volume_create_manager' (6accb4a9-ccea-4abc-a58d-7cf5d2f25e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a47274c-e5da-4b3a-99d8-188485d7d7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a47274c-e5da-4b3a-99d8-188485d7d7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1279517074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc748ffc-4346-486d-ae54-1fce344af03e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dcf391bc9af400687f84b1cde9f223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:40Z,use_quota=True,user_id='5586f606eb2548a884ff7406fc5f7a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a3b23-b874-4779-9fca-28e7f7a371ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a3b23-b874-4779-9fca-28e7f7a371ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44829e86-ed23-4897-af5d-0d02b6759511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44829e86-ed23-4897-af5d-0d02b6759511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc748ffc-4346-486d-ae54-1fce344af03e', 'volume_name': 'volume-dc748ffc-4346-486d-ae54-1fce344af03e', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229d3a0-4282-4807-b81e-605ced15e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229d3a0-4282-4807-b81e-605ced15e804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f12593e-20d5-4906-8536-13744de58a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Volume dc748ffc-4346-486d-ae54-1fce344af03e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc748ffc-4346-486d-ae54-1fce344af03e', 'volume_size': 1} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:40 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 1073741824" returned: 0 in 0.566s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:40 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 Apr 22 08:58:40 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:40 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1279517074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc748ffc-4346-486d-ae54-1fce344af03e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dcf391bc9af400687f84b1cde9f223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:40Z,use_quota=True,user_id='5586f606eb2548a884ff7406fc5f7a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Creating volume dc748ffc-4346-486d-ae54-1fce344af03e {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:40 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:40 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e 1073741824 Apr 22 08:58:40 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ec5de4-c7fe-4425-bfef-809efb184aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1deb00f-2927-471d-9b94-4ddc5806fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Flow 'volume_create_manager' (eb8f899e-cf6b-4303-babb-51ede177eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0277a9-87fe-4c74-a394-39e919f1b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Volume volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 (7b8e1af1-82de-4c48-8f8a-f27683e7f6b2): created successfully Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1deb00f-2927-471d-9b94-4ddc5806fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Flow 'volume_create_manager' (359d57d2-1176-47ca-8344-17abac2e9e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0277a9-87fe-4c74-a394-39e919f1b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-786612218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818c3ee4-c992-4091-b4a3-1599e77ad564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdf73b2d69a4ce6a2993b0f61113807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:41Z,use_quota=True,user_id='d087576a252d43d5bcf04362461b3db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c42a07d-f448-43df-8189-8528d3c41f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c42a07d-f448-43df-8189-8528d3c41f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfdb391-1df4-4b06-82f6-52e1de680da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfdb391-1df4-4b06-82f6-52e1de680da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818c3ee4-c992-4091-b4a3-1599e77ad564', 'volume_name': 'volume-818c3ee4-c992-4091-b4a3-1599e77ad564', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffc188a-88ab-4a78-94bb-a64632369cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffc188a-88ab-4a78-94bb-a64632369cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc53dd41-d4a1-4da9-b87a-0722f403d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:40 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Volume 818c3ee4-c992-4091-b4a3-1599e77ad564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818c3ee4-c992-4091-b4a3-1599e77ad564', 'volume_size': 1} Apr 22 08:58:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:40 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6ccdc5b4-5c90-424b-b988-abad9650752b tempest-VolumesTransfersTest-111570047 None] Created volume successfully. Apr 22 08:58:41 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e 1073741824" returned: 0 in 0.501s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:41 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e Apr 22 08:58:41 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Acquiring lock "cinder-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Acquiring lock "cinder-quobyte-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-quobyte-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b1163-1fb3-4165-a9ab-8f62f4a352f7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:41 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 Apr 22 08:58:41 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:41 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e" returned: 0 in 0.484s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-786612218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818c3ee4-c992-4091-b4a3-1599e77ad564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdf73b2d69a4ce6a2993b0f61113807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:41Z,use_quota=True,user_id='d087576a252d43d5bcf04362461b3db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Creating volume 818c3ee4-c992-4091-b4a3-1599e77ad564 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:41 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f12593e-20d5-4906-8536-13744de58a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc748ffc-4346-486d-ae54-1fce344af03e', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a49350-e063-4ff9-9564-4e56c3abd60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:41 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 1073741824 Apr 22 08:58:41 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Volume volume-dc748ffc-4346-486d-ae54-1fce344af03e (dc748ffc-4346-486d-ae54-1fce344af03e): created successfully Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a49350-e063-4ff9-9564-4e56c3abd60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Flow 'volume_create_manager' (6accb4a9-ccea-4abc-a58d-7cf5d2f25e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9c075810-3685-4bb7-9c3c-2a26d956b8ea tempest-VolumesTestJSON-415558379 None] Created volume successfully. Apr 22 08:58:42 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:42 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2 Apr 22 08:58:42 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:42 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 1073741824" returned: 0 in 0.552s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:42 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 Apr 22 08:58:42 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Flow 'volume_create_manager' (7e5bcf64-5da5-497f-ab78-1a4d0899fd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3cc308-bcb7-46e3-ade5-d98f3cebd2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3cc308-bcb7-46e3-ade5-d98f3cebd2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2052892057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6760b146-e91b-4527-83c7-21ac9e048845,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dcf391bc9af400687f84b1cde9f223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:43Z,use_quota=True,user_id='5586f606eb2548a884ff7406fc5f7a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6630cb75-1c0d-4db7-a554-8efa01531e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6630cb75-1c0d-4db7-a554-8efa01531e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a8e0bd-492b-4d55-a968-6dd5dbe466ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a8e0bd-492b-4d55-a968-6dd5dbe466ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6760b146-e91b-4527-83c7-21ac9e048845', 'volume_name': 'volume-6760b146-e91b-4527-83c7-21ac9e048845', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551bb117-4d9f-4c05-8020-51a1dd23d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551bb117-4d9f-4c05-8020-51a1dd23d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56296eed-4bc4-4592-8481-c9dc13f3c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Volume 6760b146-e91b-4527-83c7-21ac9e048845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6760b146-e91b-4527-83c7-21ac9e048845', 'volume_size': 1} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:42 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-quobyte-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2" released by "delete_volume" :: held 1.023s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Created reservations ['39246335-43c2-4c8c-a4aa-24bb31d63519', '26a20e92-8824-4f7e-b132-4493b7eb1fe8', '1bafd73d-0396-4952-8427-edd49d4ce3b9', 'c2576049-6699-4dff-a268-aa62fdd9e0e9'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:42 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:42 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:42 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564" returned: 0 in 0.457s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.224s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2052892057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6760b146-e91b-4527-83c7-21ac9e048845,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dcf391bc9af400687f84b1cde9f223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:43Z,use_quota=True,user_id='5586f606eb2548a884ff7406fc5f7a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Creating volume 6760b146-e91b-4527-83c7-21ac9e048845 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:42 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc53dd41-d4a1-4da9-b87a-0722f403d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818c3ee4-c992-4091-b4a3-1599e77ad564', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:42 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 1073741824 Apr 22 08:58:42 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5034b36d-58d6-4344-b0ec-9514764a9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Volume volume-818c3ee4-c992-4091-b4a3-1599e77ad564 (818c3ee4-c992-4091-b4a3-1599e77ad564): created successfully Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5034b36d-58d6-4344-b0ec-9514764a9edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Flow 'volume_create_manager' (eb8f899e-cf6b-4303-babb-51ede177eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-76a6931b-fc58-4eaa-a25d-bf7f75e2e438 tempest-VolumesListTestJSON-845429107 None] Created volume successfully. Apr 22 08:58:43 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.431s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Deleted volume successfully. Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0edd4405-fb37-4442-b526-f593c668c297 tempest-VolumesTransfersTest-1487339211 None] Lock "cinder-7b8e1af1-82de-4c48-8f8a-f27683e7f6b2-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:43 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 1073741824" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:43 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 Apr 22 08:58:43 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:43 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845" returned: 0 in 0.415s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56296eed-4bc4-4592-8481-c9dc13f3c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6760b146-e91b-4527-83c7-21ac9e048845', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac61751-bc0a-48b6-ba7c-9fd70cedbd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Volume volume-6760b146-e91b-4527-83c7-21ac9e048845 (6760b146-e91b-4527-83c7-21ac9e048845): created successfully Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac61751-bc0a-48b6-ba7c-9fd70cedbd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Flow 'volume_create_manager' (7e5bcf64-5da5-497f-ab78-1a4d0899fd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b343ca0e-7afd-4082-9573-6943da7b6e5e tempest-VolumesTestJSON-415558379 None] Created volume successfully. Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Flow 'volume_create_manager' (643ae146-7cd2-465d-9d39-f102476fa314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b91f094-2a7e-4f9d-b33f-b8239f81ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b91f094-2a7e-4f9d-b33f-b8239f81ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1051987346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e816bcaf-e0b8-4a57-9684-96c8c5041301,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdf73b2d69a4ce6a2993b0f61113807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:44Z,use_quota=True,user_id='d087576a252d43d5bcf04362461b3db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b67d58-596a-4ddf-a16f-96836c346b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b67d58-596a-4ddf-a16f-96836c346b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c01b58-6e73-408f-9a72-38901fc43924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c01b58-6e73-408f-9a72-38901fc43924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e816bcaf-e0b8-4a57-9684-96c8c5041301', 'volume_name': 'volume-e816bcaf-e0b8-4a57-9684-96c8c5041301', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4638105d-4510-42a6-a087-abb3ba50e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4638105d-4510-42a6-a087-abb3ba50e076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5adc5f-1e65-4b7a-9f67-7754b60b168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:44 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Volume e816bcaf-e0b8-4a57-9684-96c8c5041301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e816bcaf-e0b8-4a57-9684-96c8c5041301', 'volume_size': 1} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1051987346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e816bcaf-e0b8-4a57-9684-96c8c5041301,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdf73b2d69a4ce6a2993b0f61113807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:44Z,use_quota=True,user_id='d087576a252d43d5bcf04362461b3db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Creating volume e816bcaf-e0b8-4a57-9684-96c8c5041301 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:44 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:44 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 1073741824 Apr 22 08:58:44 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:45 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 1073741824" returned: 0 in 0.703s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:45 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 Apr 22 08:58:45 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Flow 'volume_create_manager' (76262b4a-a1f2-4df1-91f1-097d175e89b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1508e17-ec1e-4aa4-9477-95cd4e75f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1508e17-ec1e-4aa4-9477-95cd4e75f73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-263568497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dcf391bc9af400687f84b1cde9f223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:45Z,use_quota=True,user_id='5586f606eb2548a884ff7406fc5f7a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0ff8bc-5794-4cc7-b7bc-3d36e10ed32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0ff8bc-5794-4cc7-b7bc-3d36e10ed32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09504331-f658-4bc8-9704-42dfb138000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09504331-f658-4bc8-9704-42dfb138000e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f', 'volume_name': 'volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1633cc-5324-4a5b-9c6c-fa74314403a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1633cc-5324-4a5b-9c6c-fa74314403a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7159e35a-fb1f-4f3d-a044-ab61abd6d63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:45 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Volume aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f', 'volume_size': 1} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:45 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301" returned: 0 in 0.533s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-263568497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dcf391bc9af400687f84b1cde9f223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:45Z,use_quota=True,user_id='5586f606eb2548a884ff7406fc5f7a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Creating volume aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:45 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:45 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f 1073741824 Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5adc5f-1e65-4b7a-9f67-7754b60b168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e816bcaf-e0b8-4a57-9684-96c8c5041301', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:45 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f170b8-cda8-4db1-afa4-fb27ebd2affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:45 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Volume volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 (e816bcaf-e0b8-4a57-9684-96c8c5041301): created successfully Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f170b8-cda8-4db1-afa4-fb27ebd2affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Flow 'volume_create_manager' (643ae146-7cd2-465d-9d39-f102476fa314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-25ed5d71-49a1-4e32-8787-6fa95038daf4 tempest-VolumesListTestJSON-845429107 None] Created volume successfully. Apr 22 08:58:46 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f 1073741824" returned: 0 in 0.615s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:46 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f Apr 22 08:58:46 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:46 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f" returned: 0 in 0.534s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7159e35a-fb1f-4f3d-a044-ab61abd6d63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fd6c46-f848-4489-b629-1493c3070dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:46 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Volume volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f (aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f): created successfully Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fd6c46-f848-4489-b629-1493c3070dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Flow 'volume_create_manager' (76262b4a-a1f2-4df1-91f1-097d175e89b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b6adb019-47d0-4fb0-9f08-0bf169bbcf00 tempest-VolumesTestJSON-415558379 None] Created volume successfully. Apr 22 08:58:47 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-16c030a5-aff9-4230-9f23-f11d5db9ea72 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Terminate volume connection completed successfully. Apr 22 08:58:47 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-16c030a5-aff9-4230-9f23-f11d5db9ea72 tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Deleting attachment ce6234ff-b137-4937-a7f4-c0fde2518151. {{(pid=83774) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "cinder-f7a31314-5885-4b0e-9b56-34990af650db-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-f7a31314-5885-4b0e-9b56-34990af650db-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "cinder-quobyte-f7a31314-5885-4b0e-9b56-34990af650db" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-quobyte-f7a31314-5885-4b0e-9b56-34990af650db" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Acquiring lock "cinder-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c7a485-0a58-4cc7-8d82-46a3b39ff6ac]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Lock "cinder-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Acquiring lock "cinder-quobyte-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Lock "cinder-quobyte-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f3f1d-316e-4cc6-8173-ce08c4918ba1]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:48 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db Apr 22 08:58:48 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:48 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f Apr 22 08:58:48 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "cinder-e816bcaf-e0b8-4a57-9684-96c8c5041301-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:48 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db" returned: 0 in 0.647s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Lock "cinder-e816bcaf-e0b8-4a57-9684-96c8c5041301-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:48 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db Apr 22 08:58:48 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "cinder-quobyte-e816bcaf-e0b8-4a57-9684-96c8c5041301" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Lock "cinder-quobyte-e816bcaf-e0b8-4a57-9684-96c8c5041301" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[09304b45-d8b5-4131-b84a-92d85f72bc40]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 Apr 22 08:58:49 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Flow 'volume_create_manager' (85f4503b-0258-4109-bc36-150d79a5e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:49 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed51c75-805d-4f5a-aa0a-0e0082c64e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f" returned: 0 in 0.747s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f Apr 22 08:58:49 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed51c75-805d-4f5a-aa0a-0e0082c64e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1374165425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b559f3d-cda8-4432-a860-e2539092dc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a657125faeac45bebed3aab704899310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:49Z,use_quota=True,user_id='52f9672d139546d59b158e72cb604114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb52ee1-339c-423e-9538-9eff56d00a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb52ee1-339c-423e-9538-9eff56d00a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c9d782-f292-4ab1-b3dd-4411e0953ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c9d782-f292-4ab1-b3dd-4411e0953ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b559f3d-cda8-4432-a860-e2539092dc3b', 'volume_name': 'volume-3b559f3d-cda8-4432-a860-e2539092dc3b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef2b31c-f2a3-4cce-9cdd-786b73861561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef2b31c-f2a3-4cce-9cdd-786b73861561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58143bb2-3d56-4371-b0c5-b3cc07c8f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Volume 3b559f3d-cda8-4432-a860-e2539092dc3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b559f3d-cda8-4432-a860-e2539092dc3b', 'volume_size': 1} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1374165425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b559f3d-cda8-4432-a860-e2539092dc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a657125faeac45bebed3aab704899310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:49Z,use_quota=True,user_id='52f9672d139546d59b158e72cb604114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Creating volume 3b559f3d-cda8-4432-a860-e2539092dc3b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:49 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b 1073741824 Apr 22 08:58:49 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:49 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f7a31314-5885-4b0e-9b56-34990af650db" returned: 0 in 0.578s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-quobyte-f7a31314-5885-4b0e-9b56-34990af650db" released by "delete_volume" :: held 1.248s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.quota [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Created reservations ['a2c9450f-87fd-44cd-9cd7-b1e6c7115bd6', 'cc0d6632-643b-4b8a-928c-62331110b901', '9912ccda-5f7b-4836-89c2-3cbbe4ed3b4b', '5934ee60-ad7b-4115-913c-8d0fdfcad4a6'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f" returned: 0 in 0.458s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:49 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:49 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Lock "cinder-quobyte-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f" released by "delete_volume" :: held 1.230s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:49 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301" returned: 0 in 0.583s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301 Apr 22 08:58:49 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Created reservations ['ca9e8306-08aa-4c7c-8f98-8c3f218b74b5', '4541ca47-1e04-416b-bb56-1f63b22a5e3a', 'a2ec6a00-e396-4921-8992-7f3887c1829c', '49b3325c-0e91-42b7-b781-a81862449f0f'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:49 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:49 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b 1073741824" returned: 0 in 0.594s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:49 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b Apr 22 08:58:49 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:50 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.557s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.manager [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:50 devstack cinder-volume[83774]: INFO cinder.volume.manager [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Deleted volume successfully. Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [req-4f8430a8-6eb4-4201-8125-04a177bf3abd req-5e3f33cd-a945-40d6-9de1-dbf53cb0747a tempest-ServerBootFromVolumeStableRescueTest-540912743 None] Lock "cinder-f7a31314-5885-4b0e-9b56-34990af650db-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:50 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e816bcaf-e0b8-4a57-9684-96c8c5041301" returned: 0 in 0.604s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Lock "cinder-quobyte-e816bcaf-e0b8-4a57-9684-96c8c5041301" released by "delete_volume" :: held 1.222s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Created reservations ['dfe414cc-7174-460d-a359-8683ac2ad3d7', 'de06679d-3ca9-4442-8262-d357edd51fcc', 'eedb5404-2b3d-4063-8b0c-58fce4e63a86', '33d1f065-3854-4b23-a8bd-4229cf36088a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:50 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.567s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:50 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Deleted volume successfully. Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0bf15cc2-6df9-4342-a70c-0cd29d0b19f9 tempest-VolumesTestJSON-415558379 None] Lock "cinder-aaf6aff4-c72d-4d2e-b3f1-4f5d92fd362f-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:50 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:50 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:50 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b" returned: 0 in 0.538s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58143bb2-3d56-4371-b0c5-b3cc07c8f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b559f3d-cda8-4432-a860-e2539092dc3b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e01437c-ebe9-4947-af98-3031aa391cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Volume volume-3b559f3d-cda8-4432-a860-e2539092dc3b (3b559f3d-cda8-4432-a860-e2539092dc3b): created successfully Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e01437c-ebe9-4947-af98-3031aa391cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Flow 'volume_create_manager' (85f4503b-0258-4109-bc36-150d79a5e860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:50 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-95dfe921-491b-4a51-8da1-9b2ea8d0894d tempest-VolumesTransfersV355Test-860712475 None] Created volume successfully. Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Acquiring lock "cinder-6760b146-e91b-4527-83c7-21ac9e048845-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Lock "cinder-6760b146-e91b-4527-83c7-21ac9e048845-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Acquiring lock "cinder-quobyte-6760b146-e91b-4527-83c7-21ac9e048845" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Lock "cinder-quobyte-6760b146-e91b-4527-83c7-21ac9e048845" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8326c5-207e-4848-a55e-884d34378302]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:50 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 Apr 22 08:58:50 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:50 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:50 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Deleted volume successfully. Apr 22 08:58:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db393428-40a2-4762-b3ae-c2a205a194b6 tempest-VolumesListTestJSON-845429107 None] Lock "cinder-e816bcaf-e0b8-4a57-9684-96c8c5041301-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:51 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845" returned: 0 in 0.519s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:51 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845 Apr 22 08:58:51 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Acquiring lock "cinder-818c3ee4-c992-4091-b4a3-1599e77ad564-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Lock "cinder-818c3ee4-c992-4091-b4a3-1599e77ad564-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Acquiring lock "cinder-quobyte-818c3ee4-c992-4091-b4a3-1599e77ad564" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Lock "cinder-quobyte-818c3ee4-c992-4091-b4a3-1599e77ad564" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d249231-4073-4096-aa9a-96326904a5f6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:51 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 Apr 22 08:58:51 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:51 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6760b146-e91b-4527-83c7-21ac9e048845" returned: 0 in 0.697s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Lock "cinder-quobyte-6760b146-e91b-4527-83c7-21ac9e048845" released by "delete_volume" :: held 1.237s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Created reservations ['2e645956-9595-4864-bcb2-7c76f32c7d28', '59719e31-ecb7-4735-ade8-8853e6d30570', '54f4d47f-549f-4c54-9f2b-f899dd1302db', 'acd486ae-a3ec-42b7-a882-63a716db949a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:51 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:51 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:51 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e6b6e9cb-0339-4e6c-a0e3-78891354f92d tempest-VolumesTransfersV355Test-560498737 None] Transfer volume completed successfully. Apr 22 08:58:52 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564" returned: 0 in 0.734s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:52 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564 Apr 22 08:58:52 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:52 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.530s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:52 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Deleted volume successfully. Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a11ccdb2-dd9d-4867-8fe6-0f8f5b9e7547 tempest-VolumesTestJSON-415558379 None] Lock "cinder-6760b146-e91b-4527-83c7-21ac9e048845-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:52 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-818c3ee4-c992-4091-b4a3-1599e77ad564" returned: 0 in 0.528s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Lock "cinder-quobyte-818c3ee4-c992-4091-b4a3-1599e77ad564" released by "delete_volume" :: held 1.292s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Created reservations ['b2c570a0-40b0-48c3-9b9f-80399c95472f', 'ce150f15-2b19-4fd2-a578-9662a4fcdb26', 'a31c239c-b498-4840-afad-b7c86686eef6', '88a40006-a27a-4886-aa6b-2639dfd69fe9'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Acquiring lock "cinder-dc748ffc-4346-486d-ae54-1fce344af03e-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Lock "cinder-dc748ffc-4346-486d-ae54-1fce344af03e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:52 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:52 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Acquiring lock "cinder-3b559f3d-cda8-4432-a860-e2539092dc3b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-3b559f3d-cda8-4432-a860-e2539092dc3b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Acquiring lock "cinder-quobyte-dc748ffc-4346-486d-ae54-1fce344af03e" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Lock "cinder-quobyte-dc748ffc-4346-486d-ae54-1fce344af03e" acquired by "delete_volume" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Acquiring lock "cinder-quobyte-3b559f3d-cda8-4432-a860-e2539092dc3b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d9efcd-5198-406c-b79b-9e33dbad38c7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-quobyte-3b559f3d-cda8-4432-a860-e2539092dc3b" acquired by "delete_volume" :: waited 0.028s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[161fa097-9272-4004-95da-7c2dd6d8679c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:53 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e Apr 22 08:58:53 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:53 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b Apr 22 08:58:53 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:53 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.653s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Deleted volume successfully. Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-82260516-f1f4-4313-b494-558e93b1d38f tempest-VolumesListTestJSON-845429107 None] Lock "cinder-818c3ee4-c992-4091-b4a3-1599e77ad564-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Acquiring lock "cinder-afd0eeee-6ed4-49f8-9363-701751ece2b9-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Lock "cinder-afd0eeee-6ed4-49f8-9363-701751ece2b9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Acquiring lock "cinder-quobyte-afd0eeee-6ed4-49f8-9363-701751ece2b9" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Lock "cinder-quobyte-afd0eeee-6ed4-49f8-9363-701751ece2b9" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e45aa1-6265-4816-8a55-f564e06fcb77]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:53 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e" returned: 0 in 0.599s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:53 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 Apr 22 08:58:53 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:53 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e Apr 22 08:58:53 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:53 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b" returned: 0 in 0.599s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:53 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b Apr 22 08:58:53 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:54 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-dc748ffc-4346-486d-ae54-1fce344af03e" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Lock "cinder-quobyte-dc748ffc-4346-486d-ae54-1fce344af03e" released by "delete_volume" :: held 1.144s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:54 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9" returned: 0 in 0.559s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:54 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:54 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9 Apr 22 08:58:54 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3b559f3d-cda8-4432-a860-e2539092dc3b" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Created reservations ['bcc5874c-0cda-48e0-aabf-b62084a49ec0', 'e73f028a-c0ea-4e2b-99cc-b527aedace46', 'b2260cbe-eda2-4752-bbbe-c1b1ca4dbbb6', '4a5b2a4f-e733-48a3-9faa-f6e7fc4f6f0e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-quobyte-3b559f3d-cda8-4432-a860-e2539092dc3b" released by "delete_volume" :: held 1.169s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:54 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:54 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Created reservations ['c5009fa6-6040-4c74-ba9e-e3cd575e366c', '9975e4f8-fda9-46c0-9aaa-4c37e8eb5e1c', '8a35e4b7-6a7d-4471-87d5-12ed5a7aa950', '133b46fa-3b05-4686-a1bc-a071737e400a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:54 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:54 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:54 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-afd0eeee-6ed4-49f8-9363-701751ece2b9" returned: 0 in 0.551s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Lock "cinder-quobyte-afd0eeee-6ed4-49f8-9363-701751ece2b9" released by "delete_volume" :: held 1.149s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:54 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.492s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Deleted volume successfully. Apr 22 08:58:54 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.524s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:54 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Deleted volume successfully. Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Created reservations ['d36761ba-3825-4a07-8c81-e7d6b4f961c0', '7c391621-9ea7-4ddb-8464-5ca3e9953a30', '974a8387-d435-4a59-a19b-06cac3f18f00', '6934b543-d254-40f9-a097-803978ed2ad7'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4bc24b6b-19d0-4b31-b801-068fe328333d tempest-VolumesTestJSON-415558379 None] Lock "cinder-dc748ffc-4346-486d-ae54-1fce344af03e-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8392d829-4824-4e7a-ae42-991025ea8a85 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-3b559f3d-cda8-4432-a860-e2539092dc3b-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:55 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:55 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Flow 'volume_create_manager' (08573f3b-05cd-49df-bd71-4320377b895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef72c342-229d-4e74-bb65-204c8814ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef72c342-229d-4e74-bb65-204c8814ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-249555697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d66042-71c9-4454-9bb1-9ecdeab680b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a657125faeac45bebed3aab704899310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:55Z,use_quota=True,user_id='52f9672d139546d59b158e72cb604114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0df0d15-5e2f-46a7-9411-dd7c81115dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0df0d15-5e2f-46a7-9411-dd7c81115dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fc4fce-c949-4dc5-a880-5364da890c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fc4fce-c949-4dc5-a880-5364da890c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d66042-71c9-4454-9bb1-9ecdeab680b3', 'volume_name': 'volume-83d66042-71c9-4454-9bb1-9ecdeab680b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4771d8e1-496e-45a1-bd63-b83ef4138d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4771d8e1-496e-45a1-bd63-b83ef4138d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695494b1-5244-45c7-9e99-8e3b277a24bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:55 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Volume 83d66042-71c9-4454-9bb1-9ecdeab680b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d66042-71c9-4454-9bb1-9ecdeab680b3', 'volume_size': 1} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-249555697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d66042-71c9-4454-9bb1-9ecdeab680b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a657125faeac45bebed3aab704899310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:55Z,use_quota=True,user_id='52f9672d139546d59b158e72cb604114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Creating volume 83d66042-71c9-4454-9bb1-9ecdeab680b3 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:55 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:55 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 1073741824 Apr 22 08:58:55 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:55 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.474s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Deleted volume successfully. Apr 22 08:58:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-677c08b5-55b5-498c-b699-d1d5e38dd75b tempest-VolumesListTestJSON-845429107 None] Lock "cinder-afd0eeee-6ed4-49f8-9363-701751ece2b9-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:56 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 1073741824" returned: 0 in 0.676s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:56 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 Apr 22 08:58:56 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:56 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3" returned: 0 in 0.580s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695494b1-5244-45c7-9e99-8e3b277a24bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d66042-71c9-4454-9bb1-9ecdeab680b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511dd063-3361-4cb1-9f6a-aa10383a6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:56 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Volume volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 (83d66042-71c9-4454-9bb1-9ecdeab680b3): created successfully Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511dd063-3361-4cb1-9f6a-aa10383a6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Flow 'volume_create_manager' (08573f3b-05cd-49df-bd71-4320377b895c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:56 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-18e46876-9514-4ffb-89dd-9501acc11ee8 tempest-VolumesTransfersV355Test-860712475 None] Created volume successfully. Apr 22 08:58:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Acquiring lock "cinder-83d66042-71c9-4454-9bb1-9ecdeab680b3-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-83d66042-71c9-4454-9bb1-9ecdeab680b3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:57 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:58:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Flow 'volume_create_manager' (ce008f29-290e-4b63-8014-df32b1f55831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1554b9-9992-4a95-b08d-1bca54085b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1554b9-9992-4a95-b08d-1bca54085b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1426972650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1686ab1-0553-46a4-a832-f766f2fc3fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd7172ce655451797599c32a959c7b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:58Z,use_quota=True,user_id='4679313709e74fccb13bb432cffb7345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf72ad5-d78c-4ec1-b3ac-57e29f425e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf72ad5-d78c-4ec1-b3ac-57e29f425e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfe18a8-ecf3-4532-887a-7e426b791320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfe18a8-ecf3-4532-887a-7e426b791320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1686ab1-0553-46a4-a832-f766f2fc3fab', 'volume_name': 'volume-d1686ab1-0553-46a4-a832-f766f2fc3fab', 'volume_size': 2}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d60aa4-a5da-4a68-9444-5c06d1ebfb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d60aa4-a5da-4a68-9444-5c06d1ebfb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52258e3-73e0-4518-9431-19488191fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:58 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Volume d1686ab1-0553-46a4-a832-f766f2fc3fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1686ab1-0553-46a4-a832-f766f2fc3fab', 'volume_size': 2} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1426972650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1686ab1-0553-46a4-a832-f766f2fc3fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd7172ce655451797599c32a959c7b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:58:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:58:58Z,use_quota=True,user_id='4679313709e74fccb13bb432cffb7345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Creating volume d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:58:58 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab 2147483648 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:58 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab 2147483648 Apr 22 08:58:58 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Acquiring lock "cinder-quobyte-83d66042-71c9-4454-9bb1-9ecdeab680b3" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-quobyte-83d66042-71c9-4454-9bb1-9ecdeab680b3" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88f22e-3904-4117-8544-91e325d4b5b2]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:58 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 Apr 22 08:58:58 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:58 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab 2147483648" returned: 0 in 0.550s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:58 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab Apr 22 08:58:58 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:58 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3" returned: 0 in 0.576s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:58 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3 Apr 22 08:58:58 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:59 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab" returned: 0 in 0.545s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52258e3-73e0-4518-9431-19488191fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1686ab1-0553-46a4-a832-f766f2fc3fab', 'volume_size': 2}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e2670b-c55d-47c7-851f-c00e7c4052e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:58:59 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Volume volume-d1686ab1-0553-46a4-a832-f766f2fc3fab (d1686ab1-0553-46a4-a832-f766f2fc3fab): created successfully Apr 22 08:58:59 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e2670b-c55d-47c7-851f-c00e7c4052e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Flow 'volume_create_manager' (ce008f29-290e-4b63-8014-df32b1f55831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-83d66042-71c9-4454-9bb1-9ecdeab680b3" returned: 0 in 0.523s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7d483fe2-5303-42aa-a89f-cbccf748e88b tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Created volume successfully. Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-quobyte-83d66042-71c9-4454-9bb1-9ecdeab680b3" released by "delete_volume" :: held 1.125s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Created reservations ['774e3279-1836-4332-9745-508e26c573f1', '2770a8c1-273e-43ff-92ad-8e9654314ee2', '632ce2d3-1458-409e-a447-13b2e7b0aa8f', 'e469e3ca-c518-4da3-b858-b5f208c5f82a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:58:59 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:58:59 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:58:59 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:58:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Deleted volume successfully. Apr 22 08:58:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a0c5a7e-25ad-40c0-aae1-31f13ae39d39 tempest-VolumesTransfersV355Test-1304542036 None] Lock "cinder-83d66042-71c9-4454-9bb1-9ecdeab680b3-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Creating offline snapshot d3ec3b75-290c-4a05-aca2-45b4a0043e90 of volume d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1a7ab-3054-4c92-b91b-85a1b9a2c60c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:00 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab Apr 22 08:59:00 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:00 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 2G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:00 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 2G Apr 22 08:59:00 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:01 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 2G" returned: 0 in 0.475s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1686ab1-0553-46a4-a832-f766f2fc3fab -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:01 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1686ab1-0553-46a4-a832-f766f2fc3fab -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 Apr 22 08:59:01 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:01 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1686ab1-0553-46a4-a832-f766f2fc3fab -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90" returned: 0 in 0.419s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:01 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 is being set with open permissions: ugo+rw Apr 22 08:59:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:01 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 Apr 22 08:59:01 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:02 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90" returned: 0 in 0.397s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:06 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info Apr 22 08:59:06 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:06 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info" returned: 0 in 0.557s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:06 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info is being set with open permissions: ugo+rw Apr 22 08:59:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:06 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info Apr 22 08:59:06 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:07 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.info" returned: 0 in 0.550s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.789s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-812ec9f9-85d5-4fc8-b412-8b61df743203 tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Create snapshot completed successfully Apr 22 08:59:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3f8fdf73-3acc-4257-91c5-fdb1e82cd86b tempest-GroupsTest-222749706 None] Group tempest-Group1-862829089: creating Apr 22 08:59:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3f8fdf73-3acc-4257-91c5-fdb1e82cd86b tempest-GroupsTest-222749706 None] Group tempest-Group1-862829089: created successfully Apr 22 08:59:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3f8fdf73-3acc-4257-91c5-fdb1e82cd86b tempest-GroupsTest-222749706 None] Create group completed successfully. Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "cinder-d3ec3b75-290c-4a05-aca2-45b4a0043e90-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-d3ec3b75-290c-4a05-aca2-45b4a0043e90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "cinder-quobyte-d1686ab1-0553-46a4-a832-f766f2fc3fab" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-quobyte-d1686ab1-0553-46a4-a832-f766f2fc3fab" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "cinder-quobyte-d3ec3b75-290c-4a05-aca2-45b4a0043e90" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-quobyte-d3ec3b75-290c-4a05-aca2-45b4a0043e90" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Deleting offline snapshot d3ec3b75-290c-4a05-aca2-45b4a0043e90 of volume d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] snapshot_file for this snap is: volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aa63c0-4261-43ac-8ad7-abace1bfe7f9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:07 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 Apr 22 08:59:07 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:08 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90" returned: 0 in 0.630s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1686ab1-0553-46a4-a832-f766f2fc3fab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:08 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[da90e622-5151-4e99-9ad8-fc77946528ec]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:08 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab Apr 22 08:59:08 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7dad72eb-79db-4ec0-98f1-6765f62c1733 tempest-GroupsTest-222749706 None] Group tempest-Group2-237510659: creating Apr 22 08:59:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7dad72eb-79db-4ec0-98f1-6765f62c1733 tempest-GroupsTest-222749706 None] Group tempest-Group2-237510659: created successfully Apr 22 08:59:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7dad72eb-79db-4ec0-98f1-6765f62c1733 tempest-GroupsTest-222749706 None] Create group completed successfully. Apr 22 08:59:08 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab" returned: 0 in 0.624s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:08 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 Apr 22 08:59:08 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:09 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90" returned: 0 in 0.503s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:09 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90 Apr 22 08:59:09 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:09 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab.d3ec3b75-290c-4a05-aca2-45b4a0043e90" returned: 0 in 0.416s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-quobyte-d3ec3b75-290c-4a05-aca2-45b4a0043e90" released by "_delete_snapshot" :: held 2.240s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-quobyte-d1686ab1-0553-46a4-a832-f766f2fc3fab" released by "delete_snapshot" :: held 2.253s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:10 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Created reservations ['95e93ba2-f9c9-4e47-8c73-5157e078fa8a', '04b4b50f-1b2d-4e4b-9804-51dc4f58e295', 'a74dbe46-e60d-431a-9b17-b772e9960a1e', '9c12ee91-ef79-4c57-a624-812864b0bfb2'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:11 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Delete snapshot completed successfully. Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68df5582-9505-4917-b814-af6c1efda6ab tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-d3ec3b75-290c-4a05-aca2-45b4a0043e90-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Flow 'volume_create_manager' (ac2a0d94-604e-4424-afe3-0df17c20115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0a38ab-329f-450b-89ee-268f78e81fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0a38ab-329f-450b-89ee-268f78e81fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756496226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=996e0bd8-0e6c-4c87-8961-dd1f17a11541,host='devstack@QuobyteHD#QuobyteHD',id=84db8fe5-91b0-4579-b28a-9d48ebf4a823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5896d7a5213242089bd0b5f6055afe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:12Z,use_quota=True,user_id='9e83de8feb0b4840859c759747d198f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ff98659-172b-41b5-a98e-b58f36376516),volume_type_id=3ff98659-172b-41b5-a98e-b58f36376516)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de5a1df-89c2-49f9-8376-c2f1de4ad932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de5a1df-89c2-49f9-8376-c2f1de4ad932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296d0723-9b04-40aa-9ec1-3a66f850bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296d0723-9b04-40aa-9ec1-3a66f850bf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84db8fe5-91b0-4579-b28a-9d48ebf4a823', 'volume_name': 'volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63a82d0-8ca7-4570-bfc0-93f8c7493d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63a82d0-8ca7-4570-bfc0-93f8c7493d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db279f74-e2cb-4904-8b55-30b29c7f46cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:11 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Volume 84db8fe5-91b0-4579-b28a-9d48ebf4a823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823', 'volume_size': 1} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=996e0bd8-0e6c-4c87-8961-dd1f17a11541,created_at=2026-04-22T06:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756496226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=996e0bd8-0e6c-4c87-8961-dd1f17a11541,host='devstack@QuobyteHD#QuobyteHD',id=84db8fe5-91b0-4579-b28a-9d48ebf4a823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5896d7a5213242089bd0b5f6055afe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:12Z,use_quota=True,user_id='9e83de8feb0b4840859c759747d198f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ff98659-172b-41b5-a98e-b58f36376516),volume_type_id=3ff98659-172b-41b5-a98e-b58f36376516)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Creating volume 84db8fe5-91b0-4579-b28a-9d48ebf4a823 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:11 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:11 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 1073741824 Apr 22 08:59:11 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "cinder-d1686ab1-0553-46a4-a832-f766f2fc3fab-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-d1686ab1-0553-46a4-a832-f766f2fc3fab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "cinder-quobyte-d1686ab1-0553-46a4-a832-f766f2fc3fab" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-quobyte-d1686ab1-0553-46a4-a832-f766f2fc3fab" acquired by "delete_volume" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac780d98-c6f9-4205-900b-c2e049e7a9f7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:12 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab Apr 22 08:59:12 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Flow 'volume_create_manager' (9c8918a6-d468-4f9e-acaa-a1b7fb4d1930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7848db-a137-4716-ba33-1a965cafd5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7848db-a137-4716-ba33-1a965cafd5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1211248599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c195973cce074ba398b0ac50782853c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:12Z,use_quota=True,user_id='5490ac89cd19419480eaf3f678927be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed4fcf-1905-46f5-8beb-19b6bb2b1c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed4fcf-1905-46f5-8beb-19b6bb2b1c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d220ab-bacc-495d-9bfc-2e4b6413d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d220ab-bacc-495d-9bfc-2e4b6413d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'volume_name': 'volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ef715-1a44-4c0c-a98d-374e35738e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ef715-1a44-4c0c-a98d-374e35738e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be24c5fa-3c27-463f-b505-702ddd583977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:12 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Volume 8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'volume_size': 1} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:12 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 1073741824" returned: 0 in 0.751s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:12 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab" returned: 0 in 0.563s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:12 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab Apr 22 08:59:12 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:12 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 Apr 22 08:59:12 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:12 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:12 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:12 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1686ab1-0553-46a4-a832-f766f2fc3fab" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-quobyte-d1686ab1-0553-46a4-a832-f766f2fc3fab" released by "delete_volume" :: held 1.048s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Created reservations ['55ce93be-9674-416b-bcc2-a7c12184d29b', '30139060-2439-4017-8441-507675e2b5c9', '172b4f6e-d0f0-43e3-8fc0-62763858c766', '1b567b66-0052-480b-886d-f7551f2249c7'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:13 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823" returned: 0 in 0.567s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1211248599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c195973cce074ba398b0ac50782853c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:12Z,use_quota=True,user_id='5490ac89cd19419480eaf3f678927be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Creating volume 8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:13 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db279f74-e2cb-4904-8b55-30b29c7f46cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:13 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f 1073741824 Apr 22 08:59:13 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701a7317-22bb-42ed-aa10-a85ebf1ccc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:13 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Volume volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 (84db8fe5-91b0-4579-b28a-9d48ebf4a823): created successfully Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701a7317-22bb-42ed-aa10-a85ebf1ccc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Flow 'volume_create_manager' (ac2a0d94-604e-4424-afe3-0df17c20115c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:13 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d92d8ba1-2f55-42e4-aedb-5166d9710d36 tempest-GroupsTest-222749706 None] Created volume successfully. Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:13 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:13 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:13 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:13 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:13 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:13 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Deleted volume successfully. Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f 1073741824" returned: 0 in 0.553s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a88b63a8-887c-4d68-bf1e-342ed88b65ad tempest-VolumesSnapshotNegativeTestJSON-430603906 None] Lock "cinder-d1686ab1-0553-46a4-a832-f766f2fc3fab-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:13 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:13 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:14 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.505s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be24c5fa-3c27-463f-b505-702ddd583977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135fad0d-a088-4feb-87a3-644cc1437573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:14 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Volume volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f (8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f): created successfully Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135fad0d-a088-4feb-87a3-644cc1437573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Flow 'volume_create_manager' (9c8918a6-d468-4f9e-acaa-a1b7fb4d1930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Acquiring lock "cinder-quobyte-84db8fe5-91b0-4579-b28a-9d48ebf4a823" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Lock "cinder-quobyte-84db8fe5-91b0-4579-b28a-9d48ebf4a823" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:15 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4044dbdc-b381-4cc4-bbb0-c27b4c3de1a9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:15 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 Apr 22 08:59:15 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-711ba0bb-cdcc-4feb-82e5-c4942b695bc4 tempest-VolumesCloneTest-1300743676 None] Created volume successfully. Apr 22 08:59:15 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:15 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823 Apr 22 08:59:15 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:16 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-84db8fe5-91b0-4579-b28a-9d48ebf4a823" returned: 0 in 0.395s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Lock "cinder-quobyte-84db8fe5-91b0-4579-b28a-9d48ebf4a823" released by "delete_volume" :: held 0.923s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Created reservations ['7f520ca9-3618-40e0-a18e-1af8f13778fe'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:18 devstack cinder-volume[83774]: WARNING cinder.quota [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-339090808 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-339090808, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:18 devstack cinder-volume[83774]: WARNING cinder.quota [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-339090808 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-339090808, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Created reservations ['e7573bc2-5ef2-4580-b289-87355aa029bc', '949bd275-2c45-4a0d-82bd-c5e907d0e825', '547ed312-5d04-4283-a08c-3ac02d6d7e41', 'a60cc138-5fbd-40b8-a8c2-647f8789c365'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:18 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:18 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Flow 'volume_create_manager' (829f56ee-f8cc-46c9-a1d7-e1f64d3fd399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c99b6c-82d1-4fa7-9e47-409a18759e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c99b6c-82d1-4fa7-9e47-409a18759e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1908016044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a161398-0eeb-49da-9676-0ec8d865bb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c195973cce074ba398b0ac50782853c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:19Z,use_quota=True,user_id='5490ac89cd19419480eaf3f678927be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6f2be4-d153-46a2-9a1d-09caf84c4af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6f2be4-d153-46a2-9a1d-09caf84c4af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4300ec9-8c6c-42b2-aee2-cdd4b30d9472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4300ec9-8c6c-42b2-aee2-cdd4b30d9472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4a161398-0eeb-49da-9676-0ec8d865bb18', 'volume_name': 'volume-4a161398-0eeb-49da-9676-0ec8d865bb18', 'volume_size': 2, 'source_volid': '8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad25c4b-eccc-468c-839c-c99e4b18b76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad25c4b-eccc-468c-839c-c99e4b18b76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf6324d-4141-47af-b8df-1e09491abc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:18 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Volume 4a161398-0eeb-49da-9676-0ec8d865bb18: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4a161398-0eeb-49da-9676-0ec8d865bb18', 'volume_size': 2, 'source_volid': '8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'source_volstatus': 'available'} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:18 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Cloning volume 8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f to volume 4a161398-0eeb-49da-9676-0ec8d865bb18 Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Creating offline snapshot 2aabc7a0-3190-4676-9484-3a78c54fdf92 of volume 8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[39beb4e9-18ab-4ef4-b61a-2523e78461c7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:18 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:18 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4afca107-76af-48ae-82b7-19b294c51fbc tempest-GroupSnapshotsV319Test-687211021 None] Group tempest-GroupSnapshotsV319Test-Group-15271763: creating Apr 22 08:59:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4afca107-76af-48ae-82b7-19b294c51fbc tempest-GroupSnapshotsV319Test-687211021 None] Group tempest-GroupSnapshotsV319Test-Group-15271763: created successfully Apr 22 08:59:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4afca107-76af-48ae-82b7-19b294c51fbc tempest-GroupSnapshotsV319Test-687211021 None] Create group completed successfully. Apr 22 08:59:19 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-86c75c6d-246b-42d9-814f-2d148d5e43ef tempest-GroupsTest-222749706 None] Delete group completed successfully. Apr 22 08:59:19 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.604s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:19 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 1G Apr 22 08:59:19 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Created reservations ['c2b5d659-70f1-4296-804f-cb5e53630cd5'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:19 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:19 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:19 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 1G" returned: 0 in 0.490s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:19 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 Apr 22 08:59:19 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:20 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.443s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:20 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-39207363-cd91-4235-8bcf-c6c327bb9066 tempest-GroupsTest-222749706 None] Delete group completed successfully. Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Flow 'volume_create_manager' (f02f9b2d-ec03-492a-a2f2-fccdac24788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6b2925-83cb-4eb7-b177-991f3be27b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:20 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6b2925-83cb-4eb7-b177-991f3be27b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-983369652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=546587d2-7bc4-49f0-8f24-870be242b2b7,host='devstack@QuobyteHD#QuobyteHD',id=a874a908-1be0-4142-b84f-5e783fedb06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5e4eba3742e4e33ab3470f1bde46202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:20Z,use_quota=True,user_id='b3c8d38c15af45a3a89e74a823224e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ae40560-8a53-47ee-9ce5-6766364d228f),volume_type_id=5ae40560-8a53-47ee-9ce5-6766364d228f)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc9e25f-2f09-4fdf-bbba-1fa7ba33865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc9e25f-2f09-4fdf-bbba-1fa7ba33865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddb0a59-d9d0-4b2c-9b9f-4a865dcafda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddb0a59-d9d0-4b2c-9b9f-4a865dcafda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a874a908-1be0-4142-b84f-5e783fedb06d', 'volume_name': 'volume-a874a908-1be0-4142-b84f-5e783fedb06d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250c0ca9-127a-4378-b362-757ef63a2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250c0ca9-127a-4378-b362-757ef63a2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab77fa7-1225-4d85-93ee-c19ad561dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:20 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Volume a874a908-1be0-4142-b84f-5e783fedb06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a874a908-1be0-4142-b84f-5e783fedb06d', 'volume_size': 1} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92" returned: 0 in 0.525s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:20 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 is being set with open permissions: ugo+rw Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:20 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 Apr 22 08:59:20 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:20 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:20 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info Apr 22 08:59:20 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-15996f3d-7195-4ced-b204-c2e3e3b81458 tempest-GroupsTest-222749706 None] Group tempest-GroupsTest-Group-2122734621: creating Apr 22 08:59:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-15996f3d-7195-4ced-b204-c2e3e3b81458 tempest-GroupsTest-222749706 None] Group tempest-GroupsTest-Group-2122734621: created successfully Apr 22 08:59:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-15996f3d-7195-4ced-b204-c2e3e3b81458 tempest-GroupsTest-222749706 None] Create group completed successfully. Apr 22 08:59:21 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:21 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info is being set with open permissions: ugo+rw Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:21 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info Apr 22 08:59:21 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:21 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.info" returned: 0 in 0.403s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Acquiring lock "cinder-quobyte-4a161398-0eeb-49da-9676-0ec8d865bb18" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-4a161398-0eeb-49da-9676-0ec8d865bb18" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] snapshot: 2aabc7a0-3190-4676-9484-3a78c54fdf92, volume: 4a161398-0eeb-49da-9676-0ec8d865bb18, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6fe141-3dab-4b95-bc3f-d19ee68337b8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:21 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 Apr 22 08:59:21 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:22 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f192dc6-39c7-4c67-8b22-dfd243d04c45]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:22 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:22 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Flow 'volume_create_manager' (e6121805-13d1-4f3d-9a8d-065ae332e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c9c4e1-fade-40d8-ab09-e49d4664ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c9c4e1-fade-40d8-ab09-e49d4664ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-251645214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d746f3f5-a9f3-47fc-bcc2-4ad3bb37f2e6,host='devstack@QuobyteHD#QuobyteHD',id=896907b6-de20-4ead-9c4b-adb4776dbce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5896d7a5213242089bd0b5f6055afe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:23Z,use_quota=True,user_id='9e83de8feb0b4840859c759747d198f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45e74a2f-6258-4b82-9511-65e4222bf637),volume_type_id=45e74a2f-6258-4b82-9511-65e4222bf637)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1236cc81-a3d5-414d-afb3-d167092b4138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1236cc81-a3d5-414d-afb3-d167092b4138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750456af-bf0b-48e3-9679-a9a6226f37da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750456af-bf0b-48e3-9679-a9a6226f37da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896907b6-de20-4ead-9c4b-adb4776dbce7', 'volume_name': 'volume-896907b6-de20-4ead-9c4b-adb4776dbce7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0949dfa2-ded6-4b73-b59d-d7165c374027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0949dfa2-ded6-4b73-b59d-d7165c374027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4e2a0-314c-41df-8fa8-4ba43600b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:22 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Volume 896907b6-de20-4ead-9c4b-adb4776dbce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896907b6-de20-4ead-9c4b-adb4776dbce7', 'volume_size': 1} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:22 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.512s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 08:59:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:22 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 Apr 22 08:59:22 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:24 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18" returned: 0 in 1.921s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d1274b-8fe9-43f4-b814-3c0e398bf1e3]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:24 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:24 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:25 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.606s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:59:25 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Converted 1024.00 MB image at 532.62 MB/s Apr 22 08:59:25 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 is being set with open permissions: ugo+rw Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:25 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 Apr 22 08:59:25 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:25 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18" returned: 0 in 0.403s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-4a161398-0eeb-49da-9676-0ec8d865bb18" released by "_copy_volume_from_snapshot" :: held 3.950s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Acquiring lock "cinder-quobyte-2aabc7a0-3190-4676-9484-3a78c54fdf92" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-2aabc7a0-3190-4676-9484-3a78c54fdf92" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Deleting offline snapshot 2aabc7a0-3190-4676-9484-3a78c54fdf92 of volume 8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] snapshot_file for this snap is: volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[df014bab-1d16-4843-b2d7-6addbcf249c2]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:25 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 Apr 22 08:59:25 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:26 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff821a52-27af-4970-937e-4f6c0114b82c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:26 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:26 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:26 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:26 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 Apr 22 08:59:26 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:27 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92" returned: 0 in 0.488s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:27 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92 Apr 22 08:59:27 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:27 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f.2aabc7a0-3190-4676-9484-3a78c54fdf92" returned: 0 in 0.419s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-2aabc7a0-3190-4676-9484-3a78c54fdf92" released by "_delete_snapshot" :: held 1.893s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.859s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.209s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=546587d2-7bc4-49f0-8f24-870be242b2b7,created_at=2026-04-22T06:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-983369652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=546587d2-7bc4-49f0-8f24-870be242b2b7,host='devstack@QuobyteHD#QuobyteHD',id=a874a908-1be0-4142-b84f-5e783fedb06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5e4eba3742e4e33ab3470f1bde46202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:20Z,use_quota=True,user_id='b3c8d38c15af45a3a89e74a823224e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ae40560-8a53-47ee-9ce5-6766364d228f),volume_type_id=5ae40560-8a53-47ee-9ce5-6766364d228f)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Creating volume a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:27 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf6324d-4141-47af-b8df-1e09491abc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a161398-0eeb-49da-9676-0ec8d865bb18', 'volume_size': 2, 'source_volid': '8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:27 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d 1073741824 Apr 22 08:59:27 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32836007-2a2f-4653-a0a1-f173ec097856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:DELETE=16,cinder:SELECT=154,cinder:INSERT=60,cinder:UPDATE=187 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:59:27 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Volume volume-4a161398-0eeb-49da-9676-0ec8d865bb18 (4a161398-0eeb-49da-9676-0ec8d865bb18): created successfully Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32836007-2a2f-4653-a0a1-f173ec097856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:27 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Flow 'volume_create_manager' (829f56ee-f8cc-46c9-a1d7-e1f64d3fd399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:27 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-874b4c6b-3d21-4da9-b138-b2f12338468a tempest-VolumesCloneTest-1300743676 None] Created volume successfully. Apr 22 08:59:28 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d 1073741824" returned: 0 in 0.538s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Acquiring lock "cinder-4a161398-0eeb-49da-9676-0ec8d865bb18-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:28 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d Apr 22 08:59:28 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Lock "cinder-4a161398-0eeb-49da-9676-0ec8d865bb18-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Acquiring lock "cinder-quobyte-4a161398-0eeb-49da-9676-0ec8d865bb18" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-4a161398-0eeb-49da-9676-0ec8d865bb18" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc265d61-9f6f-4aab-a571-2a702dd9befd]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:28 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 Apr 22 08:59:28 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:28 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d" returned: 0 in 0.417s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.068s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d746f3f5-a9f3-47fc-bcc2-4ad3bb37f2e6,created_at=2026-04-22T06:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-251645214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d746f3f5-a9f3-47fc-bcc2-4ad3bb37f2e6,host='devstack@QuobyteHD#QuobyteHD',id=896907b6-de20-4ead-9c4b-adb4776dbce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5896d7a5213242089bd0b5f6055afe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:23Z,use_quota=True,user_id='9e83de8feb0b4840859c759747d198f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45e74a2f-6258-4b82-9511-65e4222bf637),volume_type_id=45e74a2f-6258-4b82-9511-65e4222bf637)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Creating volume 896907b6-de20-4ead-9c4b-adb4776dbce7 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:28 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab77fa7-1225-4d85-93ee-c19ad561dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a874a908-1be0-4142-b84f-5e783fedb06d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:28 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 1073741824 Apr 22 08:59:28 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67d857f-fe4d-40b5-8dbd-f19f49639761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:28 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Volume volume-a874a908-1be0-4142-b84f-5e783fedb06d (a874a908-1be0-4142-b84f-5e783fedb06d): created successfully Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67d857f-fe4d-40b5-8dbd-f19f49639761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Flow 'volume_create_manager' (f02f9b2d-ec03-492a-a2f2-fccdac24788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:28 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-21a5cda7-9770-4c79-b4f6-3faa7206b738 tempest-GroupSnapshotsV319Test-687211021 None] Created volume successfully. Apr 22 08:59:28 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18" returned: 0 in 0.465s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:28 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18 Apr 22 08:59:28 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:29 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 1073741824" returned: 0 in 0.509s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:29 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 Apr 22 08:59:29 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:29 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-4a161398-0eeb-49da-9676-0ec8d865bb18" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-4a161398-0eeb-49da-9676-0ec8d865bb18" released by "delete_volume" :: held 0.946s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Created reservations ['5a0a43c1-93e9-4208-8967-bb63937bb173', '0cbfe084-bf41-4cd0-907e-a81abb065fa1', 'c9d451cb-c9c4-4619-99df-a0d764032468', '3a6ace6c-f999-454d-a5e6-395637fb4314'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:29 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] GroupSnapshot 1a8ef074-ab6b-4a39-9a31-dba170caaa58: creating. Apr 22 08:59:29 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:29 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Group snapshot 1a8ef074-ab6b-4a39-9a31-dba170caaa58: creating. {{(pid=83774) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Acquiring lock "cinder-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Lock "cinder-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Acquiring lock "cinder-quobyte-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d90118-6dfc-4e60-a963-cfb4fa39b42d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:29 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:29 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:29 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.300s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Creating offline snapshot 5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 of volume a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4e2a0-314c-41df-8fa8-4ba43600b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896907b6-de20-4ead-9c4b-adb4776dbce7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c60d611-bd05-47d2-af12-0ed22827d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[40142de9-8bf7-4dc9-bc5b-81abca824eb4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:29 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Volume volume-896907b6-de20-4ead-9c4b-adb4776dbce7 (896907b6-de20-4ead-9c4b-adb4776dbce7): created successfully Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c60d611-bd05-47d2-af12-0ed22827d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Flow 'volume_create_manager' (e6121805-13d1-4f3d-9a8d-065ae332e638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:29 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4872c67d-93a3-4bdc-b7e7-5c463f0608ee tempest-GroupsTest-222749706 None] Created volume successfully. Apr 22 08:59:29 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d Apr 22 08:59:29 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:29 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:29 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Deleted volume successfully. Apr 22 08:59:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9ece05d2-28f0-4cfb-83ba-c3b2e1a7ce6c tempest-VolumesCloneTest-1300743676 None] Lock "cinder-4a161398-0eeb-49da-9676-0ec8d865bb18-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:30 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:30 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f Apr 22 08:59:30 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:30 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d" returned: 0 in 0.563s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:30 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 1G Apr 22 08:59:30 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Flow 'volume_create_manager' (7ae4b28a-3bfe-42b1-8d02-69de9c097ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef16963-68d2-4edb-bf62-f1b761e7cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef16963-68d2-4edb-bf62-f1b761e7cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436177865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d746f3f5-a9f3-47fc-bcc2-4ad3bb37f2e6,host='devstack@QuobyteHD#QuobyteHD',id=8f19de33-3f72-460f-9dbd-6364c8b1f9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5896d7a5213242089bd0b5f6055afe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:30Z,use_quota=True,user_id='9e83de8feb0b4840859c759747d198f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45e74a2f-6258-4b82-9511-65e4222bf637),volume_type_id=45e74a2f-6258-4b82-9511-65e4222bf637)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652385d3-3a47-4bd5-945a-f35a6059ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652385d3-3a47-4bd5-945a-f35a6059ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0801beb2-f6c2-4e8f-b1e8-595b9f03b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0801beb2-f6c2-4e8f-b1e8-595b9f03b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f19de33-3f72-460f-9dbd-6364c8b1f9b3', 'volume_name': 'volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2ecdca-13ef-432d-b84e-c7f5490dfa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2ecdca-13ef-432d-b84e-c7f5490dfa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d242caaa-5762-4ab6-8af9-6ee837b7d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Volume 8f19de33-3f72-460f-9dbd-6364c8b1f9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3', 'volume_size': 1} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:30 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" returned: 0 in 0.444s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Lock "cinder-quobyte-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f" released by "delete_volume" :: held 0.959s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Created reservations ['282aac8f-6930-4872-bc42-2e6d33187be4', '7c0185c3-9d0d-41cf-9a2a-168462f27f01', '8b545889-d82c-4349-84d2-c2e636e0124a', 'cde6d54b-2ff9-4aae-b819-e33adc43961c'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:30 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:30 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:30 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 1G" returned: 0 in 0.535s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a874a908-1be0-4142-b84f-5e783fedb06d -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:30 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a874a908-1be0-4142-b84f-5e783fedb06d -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 Apr 22 08:59:30 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:31 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:31 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Deleted volume successfully. Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-cf8287d1-3d15-4b95-a5f9-177e27544ffc tempest-VolumesCloneTest-1300743676 None] Lock "cinder-8c1c4795-d4ad-4c23-8394-2fd0d8c9f64f-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:31 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a874a908-1be0-4142-b84f-5e783fedb06d -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" returned: 0 in 0.524s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:31 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:31 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 Apr 22 08:59:31 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:31 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:31 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info Apr 22 08:59:31 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:32 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info" returned: 0 in 0.439s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:32 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:32 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info Apr 22 08:59:32 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (a43ccf7d-e6d6-453e-b812-eea4b014649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e170887-3741-4729-9993-66ac4838e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e170887-3741-4729-9993-66ac4838e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918478834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5678f41b-f91c-4c9c-811d-d892c736c3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:32Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b9b433-bace-4217-93e7-c6ef426d1625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b9b433-bace-4217-93e7-c6ef426d1625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa80913d-643f-4b26-8a06-ac550abca6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa80913d-643f-4b26-8a06-ac550abca6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5678f41b-f91c-4c9c-811d-d892c736c3a4', 'volume_name': 'volume-5678f41b-f91c-4c9c-811d-d892c736c3a4', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104034c3-ad71-4c95-9ec7-9f3b8f67ecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104034c3-ad71-4c95-9ec7-9f3b8f67ecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f4191c-e1a2-440a-85e7-2d91d15d77fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Volume 5678f41b-f91c-4c9c-811d-d892c736c3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5678f41b-f91c-4c9c-811d-d892c736c3a4', 'volume_size': 1} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (b33a1d99-84ae-4935-a1a8-57e54f2a4e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa1f11b-7819-41aa-b861-0becd46875cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa1f11b-7819-41aa-b861-0becd46875cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141702082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddca7b5e-6898-4776-a608-68d05755981c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ada1994-609e-44df-8eea-b6624c52b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ada1994-609e-44df-8eea-b6624c52b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78cecbe-aad9-4936-8441-9581fa45dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78cecbe-aad9-4936-8441-9581fa45dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddca7b5e-6898-4776-a608-68d05755981c', 'volume_name': 'volume-ddca7b5e-6898-4776-a608-68d05755981c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f54980-f148-407e-b49f-8e7bebb09f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f54980-f148-407e-b49f-8e7bebb09f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc82df87-3c80-46ee-8b48-61d6f09a3206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Volume ddca7b5e-6898-4776-a608-68d05755981c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddca7b5e-6898-4776-a608-68d05755981c', 'volume_size': 1} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:32 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.info" returned: 0 in 0.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d746f3f5-a9f3-47fc-bcc2-4ad3bb37f2e6,created_at=2026-04-22T06:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436177865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d746f3f5-a9f3-47fc-bcc2-4ad3bb37f2e6,host='devstack@QuobyteHD#QuobyteHD',id=8f19de33-3f72-460f-9dbd-6364c8b1f9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5896d7a5213242089bd0b5f6055afe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:30Z,use_quota=True,user_id='9e83de8feb0b4840859c759747d198f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45e74a2f-6258-4b82-9511-65e4222bf637),volume_type_id=45e74a2f-6258-4b82-9511-65e4222bf637)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Creating volume 8f19de33-3f72-460f-9dbd-6364c8b1f9b3 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:32 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:32 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 1073741824 Apr 22 08:59:32 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-121d66a6-8ad2-4899-ad9c-f666cb6b7953 tempest-GroupSnapshotsV319Test-687211021 None] group_snapshot 1a8ef074-ab6b-4a39-9a31-dba170caaa58: created successfully Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (7092fce1-9213-4851-a1ef-1d0964087ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a4ffb9-0aee-4590-9864-ca34bedc6a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a4ffb9-0aee-4590-9864-ca34bedc6a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936424094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a7bb5b-c995-4f95-9c52-2f0cfd9143dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3e91fe-23c6-44fe-9b5f-51e63b54530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3e91fe-23c6-44fe-9b5f-51e63b54530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0a0b4b-76b1-471c-adf2-d967c0bee82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0a0b4b-76b1-471c-adf2-d967c0bee82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a7bb5b-c995-4f95-9c52-2f0cfd9143dc', 'volume_name': 'volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e720cbaf-b107-40ad-a0e9-c6b250cd9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e720cbaf-b107-40ad-a0e9-c6b250cd9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65992f3-43a9-4aae-a3d9-a6f1627a297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Volume 58a7bb5b-c995-4f95-9c52-2f0cfd9143dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc', 'volume_size': 1} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (e90915b8-9dbe-426b-aa07-d76fa4a122f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aef7891-02ce-4e00-a109-b5451ad8f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aef7891-02ce-4e00-a109-b5451ad8f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087759424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48431fa-dae2-4bb6-8bf3-8041b196bc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d08009-ee15-4353-8a70-13ee34306c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d08009-ee15-4353-8a70-13ee34306c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ceeb80-0a0b-464f-ba45-45ddd8c13bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ceeb80-0a0b-464f-ba45-45ddd8c13bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48431fa-dae2-4bb6-8bf3-8041b196bc5d', 'volume_name': 'volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6b1e09-f457-464f-8524-737948a60355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6b1e09-f457-464f-8524-737948a60355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd1f6b1-c53f-434d-8548-88b5e5a33007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Volume d48431fa-dae2-4bb6-8bf3-8041b196bc5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d', 'volume_size': 1} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (b9e00b5e-7c71-4fdb-a2ac-176e7f0a9ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1879fcf-15d2-4b30-a9d8-20d17dec52b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1879fcf-15d2-4b30-a9d8-20d17dec52b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976216324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9276ed7a-b756-4884-90ec-ceb0bd7c1a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecbb3ab-181e-4ba4-b1a8-5d9a27a8a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecbb3ab-181e-4ba4-b1a8-5d9a27a8a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962df8c3-c228-4764-ac36-fde5d0a30d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962df8c3-c228-4764-ac36-fde5d0a30d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9276ed7a-b756-4884-90ec-ceb0bd7c1a5c', 'volume_name': 'volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c10861-2feb-4326-a595-b8cd4476eebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c10861-2feb-4326-a595-b8cd4476eebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7171084-8d36-4dcd-a3b4-97c841c7fe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Volume 9276ed7a-b756-4884-90ec-ceb0bd7c1a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c', 'volume_size': 1} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:33 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 1073741824" returned: 0 in 0.599s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:33 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 Apr 22 08:59:33 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] group_snapshot 1a8ef074-ab6b-4a39-9a31-dba170caaa58: deleting Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] group_snapshot 1a8ef074-ab6b-4a39-9a31-dba170caaa58: deleting {{(pid=83774) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "cinder-quobyte-a874a908-1be0-4142-b84f-5e783fedb06d" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Lock "cinder-quobyte-a874a908-1be0-4142-b84f-5e783fedb06d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "cinder-quobyte-5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Lock "cinder-quobyte-5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Deleting offline snapshot 5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 of volume a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] snapshot_file for this snap is: volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba562cf-87a0-45c4-8bb3-e7ec3f14e17a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:33 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.344s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918478834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5678f41b-f91c-4c9c-811d-d892c736c3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:32Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Creating volume 5678f41b-f91c-4c9c-811d-d892c736c3a4 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d242caaa-5762-4ab6-8af9-6ee837b7d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 1073741824 Apr 22 08:59:33 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5472ea89-b959-4e88-ac88-a7789f111fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:33 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 Apr 22 08:59:33 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Volume volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 (8f19de33-3f72-460f-9dbd-6364c8b1f9b3): created successfully Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5472ea89-b959-4e88-ac88-a7789f111fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Flow 'volume_create_manager' (7ae4b28a-3bfe-42b1-8d02-69de9c097ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-565824a2-ac02-433b-b9db-71bf64870431 tempest-GroupsTest-222749706 None] Created volume successfully. Apr 22 08:59:34 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" returned: 0 in 0.520s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a874a908-1be0-4142-b84f-5e783fedb06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4257e1-0457-4d61-aa24-3089a496e496]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:34 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 1073741824" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:34 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 Apr 22 08:59:34 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:34 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d Apr 22 08:59:34 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-aae87138-16e8-4d25-b533-39dbce19057e tempest-GroupsTest-222749706 None] Update group completed successfully. Apr 22 08:59:34 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:34 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.181s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:34 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 Apr 22 08:59:34 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141702082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddca7b5e-6898-4776-a608-68d05755981c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Creating volume ddca7b5e-6898-4776-a608-68d05755981c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:34 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f4191c-e1a2-440a-85e7-2d91d15d77fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5678f41b-f91c-4c9c-811d-d892c736c3a4', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09eb74-e073-43f9-bf9a-e975ec8e6130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:34 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c 1073741824 Apr 22 08:59:34 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Volume volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 (5678f41b-f91c-4c9c-811d-d892c736c3a4): created successfully Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09eb74-e073-43f9-bf9a-e975ec8e6130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (a43ccf7d-e6d6-453e-b812-eea4b014649f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e51a4f12-255c-4041-91f4-941d3107977f tempest-CreateVolumesFromImageTest-20475504 None] Created volume successfully. Apr 22 08:59:35 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:35 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5 Apr 22 08:59:35 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:35 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c 1073741824" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:35 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c Apr 22 08:59:35 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:35 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d.5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" returned: 0 in 0.455s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Lock "cinder-quobyte-5375836b-16a1-4f29-bb8e-cfb65f8e1ef5" released by "_delete_snapshot" :: held 2.000s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Lock "cinder-quobyte-a874a908-1be0-4142-b84f-5e783fedb06d" released by "delete_snapshot" :: held 2.012s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:35 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.902s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936424094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a7bb5b-c995-4f95-9c52-2f0cfd9143dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Creating volume 58a7bb5b-c995-4f95-9c52-2f0cfd9143dc {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:35 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:35 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc 1073741824 Apr 22 08:59:35 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc82df87-3c80-46ee-8b48-61d6f09a3206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddca7b5e-6898-4776-a608-68d05755981c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f599e18-32f1-45a5-896f-35d4eac1bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:35 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Volume volume-ddca7b5e-6898-4776-a608-68d05755981c (ddca7b5e-6898-4776-a608-68d05755981c): created successfully Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f599e18-32f1-45a5-896f-35d4eac1bb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (b33a1d99-84ae-4935-a1a8-57e54f2a4e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-19a755e5-4a84-4f1a-92e4-9bc9c644f86a tempest-CreateVolumesFromImageTest-20475504 None] Created volume successfully. Apr 22 08:59:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1323b1f2-9e71-4753-9dc0-b4d326523fcc tempest-GroupsTest-222749706 None] Update group completed successfully. Apr 22 08:59:36 devstack cinder-volume[83774]: WARNING cinder.quota [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-497120395 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-497120395, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:36 devstack cinder-volume[83774]: WARNING cinder.quota [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-497120395 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-497120395, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] Created reservations ['983024a0-b293-4e4c-9c6f-e3ab575c2914', '6575dd62-228f-4132-ba2c-4463eb1a5929', '56634a31-1836-4bca-b5e9-1f3e0d4ae357', '3004e5c4-569d-44c3-8d33-42b5f1209405'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-be5d677d-5896-491f-b246-8b9d29a1a69d tempest-GroupSnapshotsV319Test-687211021 None] group_snapshot 1a8ef074-ab6b-4a39-9a31-dba170caaa58: deleted successfully Apr 22 08:59:36 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc 1073741824" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:36 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc Apr 22 08:59:36 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:36 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc" returned: 0 in 0.409s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.718s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087759424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48431fa-dae2-4bb6-8bf3-8041b196bc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Creating volume d48431fa-dae2-4bb6-8bf3-8041b196bc5d {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:36 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:36 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d 1073741824 Apr 22 08:59:36 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65992f3-43a9-4aae-a3d9-a6f1627a297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a9a41e-8f35-495f-aee9-ec05d7bf8e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:36 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Volume volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc (58a7bb5b-c995-4f95-9c52-2f0cfd9143dc): created successfully Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a9a41e-8f35-495f-aee9-ec05d7bf8e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (7092fce1-9213-4851-a1ef-1d0964087ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9124e494-4d52-48cf-adfb-c90678366876 tempest-CreateVolumesFromImageTest-20475504 None] Created volume successfully. Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Acquiring lock "cinder-quobyte-896907b6-de20-4ead-9c4b-adb4776dbce7" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "cinder-quobyte-a874a908-1be0-4142-b84f-5e783fedb06d" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Lock "cinder-quobyte-896907b6-de20-4ead-9c4b-adb4776dbce7" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Lock "cinder-quobyte-a874a908-1be0-4142-b84f-5e783fedb06d" acquired by "delete_volume" :: waited 0.027s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba3184-b33b-4882-8612-e9a51e3213b1]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ced80-0483-4393-8ea6-e3340c85a2f7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:37 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 Apr 22 08:59:37 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:37 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d Apr 22 08:59:37 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:37 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d 1073741824" returned: 0 in 0.583s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:37 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d Apr 22 08:59:37 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:37 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:37 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7" returned: 0 in 0.519s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:37 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d Apr 22 08:59:37 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:37 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7 Apr 22 08:59:37 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:37 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d" returned: 0 in 0.413s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.537s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976216324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9276ed7a-b756-4884-90ec-ceb0bd7c1a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d17c80b36842159e6b010f042e394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:33Z,use_quota=True,user_id='e40b58afbcb447caa7dcf875a8a5fbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Creating volume 9276ed7a-b756-4884-90ec-ceb0bd7c1a5c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:37 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd1f6b1-c53f-434d-8548-88b5e5a33007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:37 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c 1073741824 Apr 22 08:59:37 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255d88a0-5cd3-47c7-af60-b55ded69ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:37 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Volume volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d (d48431fa-dae2-4bb6-8bf3-8041b196bc5d): created successfully Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255d88a0-5cd3-47c7-af60-b55ded69ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (e90915b8-9dbe-426b-aa07-d76fa4a122f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-88019e3e-4d22-41fc-9648-58963e96b5ad tempest-CreateVolumesFromImageTest-20475504 None] Created volume successfully. Apr 22 08:59:38 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a874a908-1be0-4142-b84f-5e783fedb06d" returned: 0 in 0.420s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Lock "cinder-quobyte-a874a908-1be0-4142-b84f-5e783fedb06d" released by "delete_volume" :: held 0.950s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Created reservations ['4c931037-d8ce-49d2-b8af-6255e87ce543'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:38 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-896907b6-de20-4ead-9c4b-adb4776dbce7" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Lock "cinder-quobyte-896907b6-de20-4ead-9c4b-adb4776dbce7" released by "delete_volume" :: held 1.023s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Acquiring lock "cinder-quobyte-8f19de33-3f72-460f-9dbd-6364c8b1f9b3" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Lock "cinder-quobyte-8f19de33-3f72-460f-9dbd-6364c8b1f9b3" acquired by "delete_volume" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:38 devstack cinder-volume[83774]: WARNING cinder.quota [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-497120395 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-497120395, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad14df-e4d1-4fa8-b374-02fe08295a71]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Created reservations ['28c1a77e-c816-42b6-8bed-61d37d17dbcb', 'a9e2946e-4bc1-4c16-85ec-4e9fff4f633f', '77a23c00-1302-4e79-87f1-154a5c1dcd27', 'a5cd54f0-c604-4132-88db-1300d207bfcf'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:38 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 Apr 22 08:59:38 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:38 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:38 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:38 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c 1073741824" returned: 0 in 0.538s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:38 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c Apr 22 08:59:38 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:38 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3" returned: 0 in 0.551s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:38 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:38 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3 Apr 22 08:59:38 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-46594a72-f4eb-4d97-bb00-5526f4dd09a6 tempest-GroupSnapshotsV319Test-687211021 None] Delete group completed successfully. Apr 22 08:59:38 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=172,cinder:UPDATE=229,cinder:INSERT=43,cinder:DELETE=15 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7171084-8d36-4dcd-a3b4-97c841c7fe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e89ac1e-97cb-43bc-8ee2-10df5851a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:38 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Volume volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c (9276ed7a-b756-4884-90ec-ceb0bd7c1a5c): created successfully Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e89ac1e-97cb-43bc-8ee2-10df5851a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Flow 'volume_create_manager' (b9e00b5e-7c71-4fdb-a2ac-176e7f0a9ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5c5ca17e-16e8-4225-a30c-b1168926afa8 tempest-CreateVolumesFromImageTest-20475504 None] Created volume successfully. Apr 22 08:59:39 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8f19de33-3f72-460f-9dbd-6364c8b1f9b3" returned: 0 in 0.398s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Lock "cinder-quobyte-8f19de33-3f72-460f-9dbd-6364c8b1f9b3" released by "delete_volume" :: held 0.978s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Created reservations ['7cea3b08-fe8c-417a-acb8-6240ab9d3921'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:39 devstack cinder-volume[83774]: WARNING cinder.quota [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-718195026 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-718195026, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:39 devstack cinder-volume[83774]: WARNING cinder.quota [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-718195026 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-718195026, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Created reservations ['a2067619-86fe-4d65-b228-bfd5fbfcf80b', '0cd0fc3e-bbfc-4480-ab08-7442842b9d23', '733a3a00-1e35-4f2d-a3ac-503163279cb0', '0dc82e9e-5712-4d82-87f4-3e306ad563a8'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Created reservations ['ca9d4678-2e53-4cf4-aa3c-2454c482cc6c', '0f163480-75e5-4f84-af6e-8b7a7af9a652', 'dcc4c050-e378-4728-b996-0fa546997037', '354e68dd-fe1e-4d2b-8c20-64c877df95fc'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:39 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:39 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-quobyte-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[587865f9-6b19-4666-9e81-2e08dfff3a91]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:39 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c Apr 22 08:59:39 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:39 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.482s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:39 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a9ce01e6-fc18-4837-bb0d-ac507399cebf tempest-GroupsTest-222749706 None] Delete group completed successfully. Apr 22 08:59:40 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c" returned: 0 in 0.505s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:40 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c Apr 22 08:59:40 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:40 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c" returned: 0 in 0.524s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c" released by "delete_volume" :: held 1.055s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:40 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Created reservations ['4cfde507-ce6b-48d8-895b-4f6dd73607e2', '3788ef85-056a-450a-802e-c25427d91102', '44f86744-53b8-4287-8ed0-29a795ea3bc7', '774bb6ec-7c58-4833-83a6-17a196a4c92a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:41 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:41 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:41 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.488s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Deleted volume successfully. Apr 22 08:59:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a1c2b46f-0555-42d9-be01-c43ea43da401 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-9276ed7a-b756-4884-90ec-ceb0bd7c1a5c-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-d48431fa-dae2-4bb6-8bf3-8041b196bc5d-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-d48431fa-dae2-4bb6-8bf3-8041b196bc5d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-quobyte-d48431fa-dae2-4bb6-8bf3-8041b196bc5d" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-d48431fa-dae2-4bb6-8bf3-8041b196bc5d" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff856fa-4d21-402f-b35a-210570b3fb59]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:42 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d Apr 22 08:59:42 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:42 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d" returned: 0 in 0.602s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:42 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d Apr 22 08:59:42 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2e4d6a94-417f-4af3-98c2-fb5c07f6ef62 tempest-GroupsV314Test-471976771 None] Group tempest-GroupsV314Test-Group-895841604: creating Apr 22 08:59:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2e4d6a94-417f-4af3-98c2-fb5c07f6ef62 tempest-GroupsV314Test-471976771 None] Group tempest-GroupsV314Test-Group-895841604: created successfully Apr 22 08:59:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2e4d6a94-417f-4af3-98c2-fb5c07f6ef62 tempest-GroupsV314Test-471976771 None] Create group completed successfully. Apr 22 08:59:43 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d48431fa-dae2-4bb6-8bf3-8041b196bc5d" returned: 0 in 0.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-d48431fa-dae2-4bb6-8bf3-8041b196bc5d" released by "delete_volume" :: held 1.116s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Created reservations ['47a7aecd-42c9-4fc3-9b68-ec500a81c9df', 'af22e782-4e3d-436e-8333-5e89734f4275', '96800fd9-7ce7-4d7c-91c3-fe2da2e293f3', '073794e0-5cdf-480f-b99e-3b34c30b3256'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:43 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:43 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:43 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Deleted volume successfully. Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-417be735-8969-4aa0-8b15-e8301b09e9f4 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-d48431fa-dae2-4bb6-8bf3-8041b196bc5d-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Flow 'volume_create_manager' (266e2659-2d1a-440b-91bd-589d00173be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedeb37a-0496-48c4-bee9-da09403b8aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedeb37a-0496-48c4-bee9-da09403b8aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1672895477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a23252-5392-4c97-9659-08ee67f10bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9b99d194b34f0a81a7ff64d7200e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:44Z,use_quota=True,user_id='e7e5160cd12e4f1ea53ccb831cbbd268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1751e91f-1124-4f72-b026-d23f4e57b302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1751e91f-1124-4f72-b026-d23f4e57b302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1db150-cb8a-4a40-bd34-9ff36795cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1db150-cb8a-4a40-bd34-9ff36795cf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a23252-5392-4c97-9659-08ee67f10bf1', 'volume_name': 'volume-25a23252-5392-4c97-9659-08ee67f10bf1', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd94cce-2a2a-4f80-9bd9-d3f054630e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd94cce-2a2a-4f80-9bd9-d3f054630e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a584b9-d4ef-438f-823e-a5c3cff13ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Volume 25a23252-5392-4c97-9659-08ee67f10bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a23252-5392-4c97-9659-08ee67f10bf1', 'volume_size': 1} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1672895477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a23252-5392-4c97-9659-08ee67f10bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9b99d194b34f0a81a7ff64d7200e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:44Z,use_quota=True,user_id='e7e5160cd12e4f1ea53ccb831cbbd268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Creating volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:43 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:43 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 1073741824 Apr 22 08:59:43 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Flow 'volume_create_manager' (6db950af-6297-4596-999f-4b491b37cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac9660b-cf76-4e18-b4c6-c176237d3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac9660b-cf76-4e18-b4c6-c176237d3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641476558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8e37fd7-6b05-46c4-8bfd-b959eea8bff8,host='devstack@QuobyteHD#QuobyteHD',id=b403f7c6-22d7-497e-bb78-61eb8d7f03c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f572149c47b740179c9d65a787e01ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:44Z,use_quota=True,user_id='eca60c2a5dbd4ec482f0a48ad7ec195d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(584f4c4e-c631-4e5e-a78a-28f471f508de),volume_type_id=584f4c4e-c631-4e5e-a78a-28f471f508de)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c19506-8c7f-4d80-867c-5c423f9feae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c19506-8c7f-4d80-867c-5c423f9feae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c5d42c-c8ff-49bf-8661-4dcaa1511a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c5d42c-c8ff-49bf-8661-4dcaa1511a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b403f7c6-22d7-497e-bb78-61eb8d7f03c8', 'volume_name': 'volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d769c9-10fe-49c7-af3a-0d47a1f6f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d769c9-10fe-49c7-af3a-0d47a1f6f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13afd18-4673-4424-8c29-cbe141a23037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:44 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Volume b403f7c6-22d7-497e-bb78-61eb8d7f03c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8', 'volume_size': 1} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-quobyte-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13d1b8b-ccd3-4fea-8958-f87297f11379]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:44 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc Apr 22 08:59:44 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:44 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 1073741824" returned: 0 in 0.579s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:44 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 Apr 22 08:59:44 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:44 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc" returned: 0 in 0.473s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:44 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc Apr 22 08:59:44 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:44 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1" returned: 0 in 0.398s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8e37fd7-6b05-46c4-8bfd-b959eea8bff8,created_at=2026-04-22T06:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641476558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8e37fd7-6b05-46c4-8bfd-b959eea8bff8,host='devstack@QuobyteHD#QuobyteHD',id=b403f7c6-22d7-497e-bb78-61eb8d7f03c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f572149c47b740179c9d65a787e01ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:44Z,use_quota=True,user_id='eca60c2a5dbd4ec482f0a48ad7ec195d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(584f4c4e-c631-4e5e-a78a-28f471f508de),volume_type_id=584f4c4e-c631-4e5e-a78a-28f471f508de)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Creating volume b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:44 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a584b9-d4ef-438f-823e-a5c3cff13ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a23252-5392-4c97-9659-08ee67f10bf1', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:44 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 1073741824 Apr 22 08:59:44 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28de916-04b8-4083-b653-7db46cd7e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:44 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Volume volume-25a23252-5392-4c97-9659-08ee67f10bf1 (25a23252-5392-4c97-9659-08ee67f10bf1): created successfully Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28de916-04b8-4083-b653-7db46cd7e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Flow 'volume_create_manager' (266e2659-2d1a-440b-91bd-589d00173be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d76bdf81-94ea-4173-992a-f5a224f26fdd tempest-SnapshotsActionsTest-382711650 None] Created volume successfully. Apr 22 08:59:45 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc" released by "delete_volume" :: held 0.947s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Created reservations ['bd7f4787-ee86-4341-8bbc-3922cd59ab3f', 'd6390414-e109-441d-86a2-3c64504830bd', 'a712854e-f87e-4193-9a24-09a645bb8d68', 'ea5d09de-e856-4c2e-8cc3-afdc0f30d5e0'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:45 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:45 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-ddca7b5e-6898-4776-a608-68d05755981c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-ddca7b5e-6898-4776-a608-68d05755981c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-quobyte-ddca7b5e-6898-4776-a608-68d05755981c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-ddca7b5e-6898-4776-a608-68d05755981c" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e86475-434e-4137-bb1a-ba752e12f5a0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:45 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c Apr 22 08:59:45 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:45 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 1073741824" returned: 0 in 0.527s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:45 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 08:59:45 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:45 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Deleted volume successfully. Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-755fadd3-33bf-4ee8-b955-21127d3c1674 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-58a7bb5b-c995-4f95-9c52-2f0cfd9143dc-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:45 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c" returned: 0 in 0.520s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:45 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:45 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c Apr 22 08:59:45 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13afd18-4673-4424-8c29-cbe141a23037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02e8a51-69bd-4aa7-9393-7b027a61f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:46 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Volume volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 (b403f7c6-22d7-497e-bb78-61eb8d7f03c8): created successfully Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02e8a51-69bd-4aa7-9393-7b027a61f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Flow 'volume_create_manager' (6db950af-6297-4596-999f-4b491b37cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a1131296-58aa-4dd6-a77b-3d58a7ca92ab tempest-GroupsV314Test-471976771 None] Created volume successfully. Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Creating offline snapshot ac515eaf-1e8a-464c-b94b-8140a68fb8d1 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa85a0a-f683-4086-b745-64da6a4ac0cd]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:46 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 Apr 22 08:59:46 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:46 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ddca7b5e-6898-4776-a608-68d05755981c" returned: 0 in 0.453s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-ddca7b5e-6898-4776-a608-68d05755981c" released by "delete_volume" :: held 1.003s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Created reservations ['b32398fe-a1ad-45e6-be34-f5992e636e56', 'b6dd012b-b03e-43e0-95c4-b2b768473f05', 'e70b0e02-53d8-41d0-87e2-2757ff8491da', '2a9f672f-01d6-4eb2-b1d4-16976a835783'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:46 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:46 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:46 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1" returned: 0 in 0.527s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:46 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 1G Apr 22 08:59:46 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:46 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.414s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Deleted volume successfully. Apr 22 08:59:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b9a2ff26-d2c6-4bff-9bdc-6c5a3b5a6521 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-ddca7b5e-6898-4776-a608-68d05755981c-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:47 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 1G" returned: 0 in 0.502s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:47 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 08:59:47 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-5678f41b-f91c-4c9c-811d-d892c736c3a4-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-5678f41b-f91c-4c9c-811d-d892c736c3a4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "cinder-quobyte-5678f41b-f91c-4c9c-811d-d892c736c3a4" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-5678f41b-f91c-4c9c-811d-d892c736c3a4" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e740675-3e01-4638-91dc-4c38fb2410fc]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:47 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.442s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:47 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 is being set with open permissions: ugo+rw Apr 22 08:59:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:47 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 08:59:47 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:47 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 Apr 22 08:59:47 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:48 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:48 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4" returned: 0 in 0.473s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:48 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4 Apr 22 08:59:48 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:48 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info Apr 22 08:59:48 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:48 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5678f41b-f91c-4c9c-811d-d892c736c3a4" returned: 0 in 0.410s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-quobyte-5678f41b-f91c-4c9c-811d-d892c736c3a4" released by "delete_volume" :: held 0.903s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:48 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info" returned: 0 in 0.424s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:48 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info is being set with open permissions: ugo+rw Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:48 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info Apr 22 08:59:48 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Created reservations ['d8209937-6a4a-4aba-b7e0-73a658721554', 'a015e7cc-4b95-4f79-811c-5e77dd8a4a4e', 'f5e271dc-745c-4f4d-867b-fa47bfe4f41d', '8edbba9a-aa4f-4920-b964-a5d88641ab09'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:48 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:48 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:48 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.info" returned: 0 in 0.436s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.879s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:48 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Cloning volume b403f7c6-22d7-497e-bb78-61eb8d7f03c8 to volume 139651ce-f021-42b5-831b-ff2772969bde Apr 22 08:59:48 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-13a12cb8-8c18-4c16-be3c-01d57fd478de tempest-SnapshotsActionsTest-382711650 None] Create snapshot completed successfully Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Creating offline snapshot 40864c06-9560-4370-9309-24d5e791c3b4 of volume b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f4625e-f4c2-4ee7-8075-47d9318dfb4b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:49 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:49 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:49 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Deleted volume successfully. Apr 22 08:59:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-333a3544-a538-4d46-a22f-4f7dda6e7c04 tempest-CreateVolumesFromImageTest-20475504 None] Lock "cinder-5678f41b-f91c-4c9c-811d-d892c736c3a4-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:49 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 08:59:49 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:49 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.609s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:49 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 1G Apr 22 08:59:49 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:50 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 1G" returned: 0 in 0.508s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:50 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 Apr 22 08:59:50 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (aeb5d446-8916-4982-987f-46d4fb8f060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06700d02-3e0e-4913-b0f5-44d0c5c70871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:50 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4" returned: 0 in 0.520s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:50 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06700d02-3e0e-4913-b0f5-44d0c5c70871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1117943442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0de5fe9-96c3-476c-bf4e-466d49837981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af13171e1ba04c7dacef0b9154e20365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:51Z,use_quota=True,user_id='31cafbc86b38400d82282579cbf40c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b314e5-2848-4300-a8f8-61084c5854c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:50 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 Apr 22 08:59:50 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b314e5-2848-4300-a8f8-61084c5854c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f09b814-5dca-45d1-99e7-8d8a09b7dfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f09b814-5dca-45d1-99e7-8d8a09b7dfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0de5fe9-96c3-476c-bf4e-466d49837981', 'volume_name': 'volume-c0de5fe9-96c3-476c-bf4e-466d49837981', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e8814e-66c5-4a23-93d3-5ac1a0351bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e8814e-66c5-4a23-93d3-5ac1a0351bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9b1e78-d15e-4ce7-a135-6ee659621f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 08:59:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Volume c0de5fe9-96c3-476c-bf4e-466d49837981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0de5fe9-96c3-476c-bf4e-466d49837981', 'volume_size': 1} Apr 22 08:59:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:51 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4" returned: 0 in 0.425s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:51 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info Apr 22 08:59:51 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:51 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info" returned: 0 in 0.442s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:51 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:51 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info Apr 22 08:59:51 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:51 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.info" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Acquiring lock "cinder-quobyte-139651ce-f021-42b5-831b-ff2772969bde" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-139651ce-f021-42b5-831b-ff2772969bde" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] snapshot: 40864c06-9560-4370-9309-24d5e791c3b4, volume: 139651ce-f021-42b5-831b-ff2772969bde, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df97a7-91b9-4969-b871-917e6765e9c6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:52 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 Apr 22 08:59:52 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:52 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c50d47e-1d2f-49e6-a2c7-76aae7b439b6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:52 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 08:59:52 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:52 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.457s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 08:59:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:52 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde Apr 22 08:59:52 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:54 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde" returned: 0 in 1.946s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:54 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527255f-4e3d-4d6a-81ec-c29651448799]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:54 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 08:59:54 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:55 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.603s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 08:59:55 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Converted 1024.00 MB image at 525.90 MB/s Apr 22 08:59:55 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde is being set with open permissions: ugo+rw: NotImplementedError Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:55 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde Apr 22 08:59:55 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:55 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde" returned: 0 in 0.431s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-139651ce-f021-42b5-831b-ff2772969bde" released by "_copy_volume_from_snapshot" :: held 3.940s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Acquiring lock "cinder-quobyte-40864c06-9560-4370-9309-24d5e791c3b4" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-40864c06-9560-4370-9309-24d5e791c3b4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Deleting offline snapshot 40864c06-9560-4370-9309-24d5e791c3b4 of volume b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] snapshot_file for this snap is: volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d73a70-0b4c-4e44-a604-331eac0ea5b5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:56 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 Apr 22 08:59:56 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:56 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:56 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd8601c-bfba-4dce-8576-ae4c4d570716]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:56 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 08:59:56 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:56 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:56 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 Apr 22 08:59:56 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:57 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4" returned: 0 in 0.431s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:57 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4 Apr 22 08:59:57 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:57 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8.40864c06-9560-4370-9309-24d5e791c3b4" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-40864c06-9560-4370-9309-24d5e791c3b4" released by "_delete_snapshot" :: held 1.833s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.809s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.069s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Creating offline snapshot 49cec48e-d762-46d8-8e95-aaab9b98bdd3 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4640558-e545-4b1d-b21d-0980db4ae161]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f1397a6c-1202-45e0-b0e4-d8fef5d1d297 tempest-GroupsV314Test-471976771 None] Create group from source-group-a8e37fd7-6b05-46c4-8bfd-b959eea8bff8 completed successfully. Apr 22 08:59:57 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 08:59:57 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Acquiring lock "cinder-quobyte-139651ce-f021-42b5-831b-ff2772969bde" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-139651ce-f021-42b5-831b-ff2772969bde" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0407c6-952e-4308-a8e4-7439675b6c65]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:58 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde Apr 22 08:59:58 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:58 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.521s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:58 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 1G Apr 22 08:59:58 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:58 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:58 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde Apr 22 08:59:58 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:58 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 1G" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:58 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 Apr 22 08:59:58 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:59 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-139651ce-f021-42b5-831b-ff2772969bde" returned: 0 in 0.471s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-139651ce-f021-42b5-831b-ff2772969bde" released by "delete_volume" :: held 0.956s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Created reservations ['97bf8854-8338-48d6-98fa-64d7701bda1a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:59 devstack cinder-volume[83774]: WARNING cinder.quota [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1991292866 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1991292866, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:59 devstack cinder-volume[83774]: WARNING cinder.quota [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1991292866 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1991292866, it is now deprecated. Please use the default quota class for default quota. Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Created reservations ['9bb26751-9e60-4b1a-9424-2ceeca234b9f', '34eb584a-1cdb-46bd-835e-135cde57aff0', 'fe89771e-80de-476d-8dca-4d756788f7e3', '8af2a95c-1ed9-4d42-b0e5-7467a330da00'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:59 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 08:59:59 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:59 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3" returned: 0 in 0.449s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:59 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 is being set with open permissions: ugo+rw Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:59 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 Apr 22 08:59:59 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:59 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.410s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 08:59:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2b4b802d-152e-47fb-8484-252d7a3007bf tempest-GroupsV314Test-471976771 None] Delete group completed successfully. Apr 22 08:59:59 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3" returned: 0 in 0.416s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.048s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T06:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1117943442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0de5fe9-96c3-476c-bf4e-466d49837981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af13171e1ba04c7dacef0b9154e20365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T06:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T06:59:51Z,use_quota=True,user_id='31cafbc86b38400d82282579cbf40c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Creating volume c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 08:59:59 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 08:59:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 08:59:59 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 1073741824 Apr 22 08:59:59 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 08:59:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e21ae41e-3986-4b96-8a13-46ae4eabcdd8 tempest-SnapshotsActionsTest-382711650 None] Create snapshot completed successfully Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-49cec48e-d762-46d8-8e95-aaab9b98bdd3-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-49cec48e-d762-46d8-8e95-aaab9b98bdd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-49cec48e-d762-46d8-8e95-aaab9b98bdd3" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-49cec48e-d762-46d8-8e95-aaab9b98bdd3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Deleting offline snapshot 49cec48e-d762-46d8-8e95-aaab9b98bdd3 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] snapshot_file for this snap is: volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[08393257-97bb-4004-88b3-41a16d8b6200]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:00 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 Apr 22 09:00:00 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:00 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 1073741824" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:00 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:00 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Acquiring lock "cinder-quobyte-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b6e75-06d3-49e0-bf7e-e4a80b3cd8ab]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:00 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 09:00:00 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:00 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.434s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:00 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3" returned: 0 in 0.541s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9b1e78-d15e-4ce7-a135-6ee659621f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0de5fe9-96c3-476c-bf4e-466d49837981', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51b4d81-7d09-482e-8d9c-40d62f8afcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c019531-ee80-4061-92db-ca59274b0797]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:00 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Volume volume-c0de5fe9-96c3-476c-bf4e-466d49837981 (c0de5fe9-96c3-476c-bf4e-466d49837981): created successfully Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51b4d81-7d09-482e-8d9c-40d62f8afcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (aeb5d446-8916-4982-987f-46d4fb8f060c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:00 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7770d1ec-2741-4eb8-a106-310a89aaaf13 tempest-VolumeDependencyTests-2071264310 None] Created volume successfully. Apr 22 09:00:00 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:00 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:00 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:00 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8 Apr 22 09:00:00 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:01 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.517s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:01 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 Apr 22 09:00:01 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Creating offline snapshot d82669ee-8ea4-48e5-971d-d107d5ae533a of volume c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746c7c2-0f82-4231-813a-dd9f46d63311]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:01 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Lock "cinder-quobyte-b403f7c6-22d7-497e-bb78-61eb8d7f03c8" released by "delete_volume" :: held 0.976s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:01 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:01 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Created reservations ['bd3f8599-905c-433e-bb50-499909e5ffa4'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Created reservations ['5615d569-cee6-4f50-94ab-3b3790b7fab8', '77bc27b0-0cb5-4354-aef6-8e3637371165', '908dc63a-7540-4213-8d60-541a49060404', '0e4bcf1c-97e2-4541-ae3d-5373bf2da5c1'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:01 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:01 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:01 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3" returned: 0 in 0.532s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:01 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3 Apr 22 09:00:01 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:01 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.565s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:01 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a 1G Apr 22 09:00:01 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:01 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.455s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:01 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:01 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-75b87434-a16e-4b17-8f61-ec1afc633200 tempest-GroupsV314Test-471976771 None] Delete group completed successfully. Apr 22 09:00:02 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.49cec48e-d762-46d8-8e95-aaab9b98bdd3" returned: 0 in 0.419s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-49cec48e-d762-46d8-8e95-aaab9b98bdd3" released by "_delete_snapshot" :: held 2.070s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" released by "delete_snapshot" :: held 2.092s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Created reservations ['001e5768-d94d-4f63-aa4d-e209ac2b7109', '4ba9d463-073d-4715-bfbe-d23acb12382a', '747e8b7e-5a4c-41a8-be1a-0443a7f10c12', '6ec7ec4b-a6c4-40a3-a614-3aade5c314ce'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:02 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Delete snapshot completed successfully. Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-890f2583-0330-4727-a02e-1180af412a82 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-49cec48e-d762-46d8-8e95-aaab9b98bdd3-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:02 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a 1G" returned: 0 in 0.493s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0de5fe9-96c3-476c-bf4e-466d49837981 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:02 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0de5fe9-96c3-476c-bf4e-466d49837981 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a Apr 22 09:00:02 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:02 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0de5fe9-96c3-476c-bf4e-466d49837981 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a" returned: 0 in 0.520s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:02 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a is being set with open permissions: ugo+rw Apr 22 09:00:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:02 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a Apr 22 09:00:02 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:03 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a" returned: 0 in 0.481s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:03 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info Apr 22 09:00:03 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:03 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:03 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info is being set with open permissions: ugo+rw Apr 22 09:00:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:03 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info Apr 22 09:00:03 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:04 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.info" returned: 0 in 0.479s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.904s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Creating offline snapshot 1b9a9ec7-afee-48ed-b591-341bf755504f of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:00:04 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-aa9e4041-440a-4d27-a50b-f245ab1640c8 tempest-VolumeDependencyTests-2071264310 None] Create snapshot completed successfully Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e63b3a-e2ec-43c8-8721-e87a9cbba163]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:04 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:04 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:04 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.521s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:04 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f 1G Apr 22 09:00:04 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:05 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f 1G" returned: 0 in 0.531s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:05 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f Apr 22 09:00:05 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c079b695-a5e8-45f5-be00-5141cb729077 tempest-GroupsV320Test-556618211 None] Group tempest-GroupsV320Test-Group-30318868: creating Apr 22 09:00:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c079b695-a5e8-45f5-be00-5141cb729077 tempest-GroupsV320Test-556618211 None] Group tempest-GroupsV320Test-Group-30318868: created successfully Apr 22 09:00:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c079b695-a5e8-45f5-be00-5141cb729077 tempest-GroupsV320Test-556618211 None] Create group completed successfully. Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (466ba087-dcde-4618-b409-7a853cfaf038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0111793-8da7-4b59-a8c8-160e7ae19233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0111793-8da7-4b59-a8c8-160e7ae19233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-819964725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da31dbfa-49a1-4e06-9b63-b21cf0665414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af13171e1ba04c7dacef0b9154e20365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d82669ee-8ea4-48e5-971d-d107d5ae533a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:06Z,use_quota=True,user_id='31cafbc86b38400d82282579cbf40c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba2db07-c1be-43e0-8ba4-c33ea3eb59e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba2db07-c1be-43e0-8ba4-c33ea3eb59e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab562cf-2839-4d3b-b404-616a3d1c86c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab562cf-2839-4d3b-b404-616a3d1c86c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da31dbfa-49a1-4e06-9b63-b21cf0665414', 'volume_name': 'volume-da31dbfa-49a1-4e06-9b63-b21cf0665414', 'volume_size': 1, 'snapshot_id': 'd82669ee-8ea4-48e5-971d-d107d5ae533a'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec14fb4-4d38-486b-85ac-0b720843b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec14fb4-4d38-486b-85ac-0b720843b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c7c26f-8056-4fd9-b935-8c25e9cbed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:05 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Volume da31dbfa-49a1-4e06-9b63-b21cf0665414: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da31dbfa-49a1-4e06-9b63-b21cf0665414', 'volume_size': 1, 'snapshot_id': 'd82669ee-8ea4-48e5-971d-d107d5ae533a'} Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:05 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:05 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f is being set with open permissions: ugo+rw Apr 22 09:00:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:05 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f Apr 22 09:00:05 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:06 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.577s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-d82669ee-8ea4-48e5-971d-d107d5ae533a-da31dbfa-49a1-4e06-9b63-b21cf0665414" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-d82669ee-8ea4-48e5-971d-d107d5ae533a-da31dbfa-49a1-4e06-9b63-b21cf0665414" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Creating volume da31dbfa-49a1-4e06-9b63-b21cf0665414 from snapshot d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-da31dbfa-49a1-4e06-9b63-b21cf0665414" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-fcce5b05-3c95-4243-a912-8487219d256e tempest-SnapshotsActionsTest-382711650 None] Create snapshot completed successfully Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-da31dbfa-49a1-4e06-9b63-b21cf0665414" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] snapshot: d82669ee-8ea4-48e5-971d-d107d5ae533a, volume: da31dbfa-49a1-4e06-9b63-b21cf0665414, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd93a36-0bf3-4b0c-a9ad-4a6b5173089c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:06 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a Apr 22 09:00:06 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-1b9a9ec7-afee-48ed-b591-341bf755504f-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-1b9a9ec7-afee-48ed-b591-341bf755504f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-1b9a9ec7-afee-48ed-b591-341bf755504f" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-1b9a9ec7-afee-48ed-b591-341bf755504f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Deleting offline snapshot 1b9a9ec7-afee-48ed-b591-341bf755504f of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] snapshot_file for this snap is: volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[591d92a1-0cb5-4a09-8e62-22518be9a276]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:06 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0de5fe9-96c3-476c-bf4e-466d49837981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14fe493-aa9e-4ae4-9301-f356d7b7bf6a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:06 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f Apr 22 09:00:06 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:07 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:07 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Created reservations ['8b10c137-3957-4871-852f-3066da0d33bf'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:07 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:07 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:07 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[07037c06-8359-45f1-a28d-2bbc176fc64c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:07 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.495s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:07 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 Apr 22 09:00:07 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:07 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:07 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:07 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.412s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:07 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8e1b0c8f-3ffe-484c-9950-d07ec6f2269f tempest-GroupsV320Test-556618211 None] Delete group completed successfully. Apr 22 09:00:08 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.642s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:08 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f Apr 22 09:00:08 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:09 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f" returned: 0 in 1.331s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:09 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f Apr 22 09:00:09 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:09 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414" returned: 0 in 2.154s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1795c939-23fc-4316-ac4b-744270a40653]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:09 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:09 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:09 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.1b9a9ec7-afee-48ed-b591-341bf755504f" returned: 0 in 0.552s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-1b9a9ec7-afee-48ed-b591-341bf755504f" released by "_delete_snapshot" :: held 3.102s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" released by "delete_snapshot" :: held 3.118s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Created reservations ['28735a78-eb9e-4758-93e9-a99e260f5101', '4a812a1b-51ed-49eb-a71b-39f203fabf5a', '6d3d33d9-142f-41fa-89cb-5e440c68a2f0', '482afbd3-f3cb-4868-83ab-b807d3c63a49'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Delete snapshot completed successfully. Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae553331-c71a-4130-a8f8-4310a059b50b tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-1b9a9ec7-afee-48ed-b591-341bf755504f-delete_snapshot" released by "delete_snapshot" :: held 3.230s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:10 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.705s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:00:10 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Converted 1024.00 MB image at 475.16 MB/s Apr 22 09:00:10 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 is being set with open permissions: ugo+rw Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:10 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 Apr 22 09:00:10 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:10 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-da31dbfa-49a1-4e06-9b63-b21cf0665414" released by "_copy_volume_from_snapshot" :: held 4.367s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-d82669ee-8ea4-48e5-971d-d107d5ae533a-da31dbfa-49a1-4e06-9b63-b21cf0665414" released by "_create_volume_from_snapshot" :: held 4.386s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.404s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.388s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Creating offline snapshot 5df549dd-aa3b-487e-8d09-ee5cd01c5615 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c7c26f-8056-4fd9-b935-8c25e9cbed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da31dbfa-49a1-4e06-9b63-b21cf0665414', 'volume_size': 1, 'snapshot_id': 'd82669ee-8ea4-48e5-971d-d107d5ae533a'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3a18fe-0780-47fb-b70f-68c41a8f5e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[049935b3-798c-4039-8ddb-00d9ea5481ac]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:10 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Volume volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 (da31dbfa-49a1-4e06-9b63-b21cf0665414): created successfully Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3a18fe-0780-47fb-b70f-68c41a8f5e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (466ba087-dcde-4618-b409-7a853cfaf038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-802abb4b-f85c-42cc-9b98-ada1955a9209 tempest-VolumeDependencyTests-2071264310 None] Created volume successfully. Apr 22 09:00:10 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:10 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:11 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.506s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-d82669ee-8ea4-48e5-971d-d107d5ae533a-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-d82669ee-8ea4-48e5-971d-d107d5ae533a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:11 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 1G Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-c0de5fe9-96c3-476c-bf4e-466d49837981" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:11 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-c0de5fe9-96c3-476c-bf4e-466d49837981" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-d82669ee-8ea4-48e5-971d-d107d5ae533a" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-d82669ee-8ea4-48e5-971d-d107d5ae533a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Deleting offline snapshot d82669ee-8ea4-48e5-971d-d107d5ae533a of volume c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] snapshot_file for this snap is: volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c991eddc-e591-4b0a-9be4-b0a36e1d899a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:11 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a Apr 22 09:00:11 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:11 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a" returned: 0 in 0.477s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0de5fe9-96c3-476c-bf4e-466d49837981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[34723328-95cf-4292-8cd5-3c540575469a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:11 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 1G" returned: 0 in 0.616s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:11 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 Apr 22 09:00:11 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:11 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:11 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:12 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.531s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:12 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a Apr 22 09:00:12 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:12 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615" returned: 0 in 0.536s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:12 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 is being set with open permissions: ugo+rw Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:12 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 Apr 22 09:00:12 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:12 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:12 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:12 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:12 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a Apr 22 09:00:12 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:12 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615" returned: 0 in 0.465s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:13 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b3c6057a-8436-42f1-8baa-80bbc09a3874 tempest-SnapshotsActionsTest-382711650 None] Create snapshot completed successfully Apr 22 09:00:13 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.487s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:13 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981.d82669ee-8ea4-48e5-971d-d107d5ae533a" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-d82669ee-8ea4-48e5-971d-d107d5ae533a" released by "_delete_snapshot" :: held 2.029s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-c0de5fe9-96c3-476c-bf4e-466d49837981" released by "delete_snapshot" :: held 2.042s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Created reservations ['7a4a0702-77cd-4a1b-89dc-499d72d41ca9', '8417e9a2-9dc2-4bb2-b022-84d69d32ae5d', '24d57abb-d027-43f3-9d8f-e91c4a8e56c6', '55c35c90-9caf-48a8-bc2f-ed93b63c160c'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:13 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Delete snapshot completed successfully. Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f97c6b88-56ba-43c1-a4e7-fe4712c8ae2a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-d82669ee-8ea4-48e5-971d-d107d5ae533a-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-5df549dd-aa3b-487e-8d09-ee5cd01c5615-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-5df549dd-aa3b-487e-8d09-ee5cd01c5615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-5df549dd-aa3b-487e-8d09-ee5cd01c5615" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-5df549dd-aa3b-487e-8d09-ee5cd01c5615" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Deleting offline snapshot 5df549dd-aa3b-487e-8d09-ee5cd01c5615 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] snapshot_file for this snap is: volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d201e30-df21-4e0a-8d32-1f0f2371bb27]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:13 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 Apr 22 09:00:13 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:14 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615" returned: 0 in 0.492s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8509943-2891-4d9d-95c3-36fcc53cfb9b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:14 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:14 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-c0de5fe9-96c3-476c-bf4e-466d49837981-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-c0de5fe9-96c3-476c-bf4e-466d49837981-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-c0de5fe9-96c3-476c-bf4e-466d49837981" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-c0de5fe9-96c3-476c-bf4e-466d49837981" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a89b4-7048-467a-931e-5f1f15d21f24]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:14 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:14 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:14 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.566s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:14 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 Apr 22 09:00:14 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:15 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.538s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:15 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981 Apr 22 09:00:15 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:15 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615" returned: 0 in 0.518s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:15 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615 Apr 22 09:00:15 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:15 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0de5fe9-96c3-476c-bf4e-466d49837981" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-c0de5fe9-96c3-476c-bf4e-466d49837981" released by "delete_volume" :: held 1.019s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Flow 'volume_create_manager' (ef77e864-f276-4f41-8579-2ffba483ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60970d6a-c1fc-497c-b713-5c2850d8f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Created reservations ['990e2baf-6292-45db-ac9c-a236bf6d6b7e', '1454627e-a032-4e00-9e9e-e3f3d5a960dd', '6dacad33-1efc-4942-970f-4786abfa921d', 'c6097eb5-84c2-4dff-89ca-ecb764d3622e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60970d6a-c1fc-497c-b713-5c2850d8f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1311972024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb04a425-95db-423c-9f3e-1e782e51eb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2c8bad95114990aed86a66eb82e986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:16Z,use_quota=True,user_id='abe0c8c27eed4e90952446ef0680b7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c9d2ae-2afd-424d-bec8-25863552e879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c9d2ae-2afd-424d-bec8-25863552e879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe79e973-9cf7-48f1-ab7b-5853053296dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe79e973-9cf7-48f1-ab7b-5853053296dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb04a425-95db-423c-9f3e-1e782e51eb5e', 'volume_name': 'volume-bb04a425-95db-423c-9f3e-1e782e51eb5e', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:15 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901520da-fd39-4bf3-ba0b-805da3a79145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901520da-fd39-4bf3-ba0b-805da3a79145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca2dba9-0657-42c4-b36f-841b785f38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:15 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Volume bb04a425-95db-423c-9f3e-1e782e51eb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb04a425-95db-423c-9f3e-1e782e51eb5e', 'volume_size': 1} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1311972024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb04a425-95db-423c-9f3e-1e782e51eb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2c8bad95114990aed86a66eb82e986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:16Z,use_quota=True,user_id='abe0c8c27eed4e90952446ef0680b7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Creating volume bb04a425-95db-423c-9f3e-1e782e51eb5e {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:15 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.5df549dd-aa3b-487e-8d09-ee5cd01c5615" returned: 0 in 0.511s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:15 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e 1073741824 Apr 22 09:00:15 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-5df549dd-aa3b-487e-8d09-ee5cd01c5615" released by "_delete_snapshot" :: held 2.133s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" released by "delete_snapshot" :: held 2.148s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:15 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:15 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Created reservations ['3e8000c1-fbfb-4541-b129-0e6cd2f01659', 'b82c1fd3-0d5a-4cda-9a67-2cc2f1f15b2d', 'e24efe17-1c9c-4665-870a-c0928d9e8377', '04a90662-efea-46ce-8e92-3d90c01887dd'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Delete snapshot completed successfully. Apr 22 09:00:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-645cc553-3cca-4ca1-bf3b-25bfe553ea66 tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-5df549dd-aa3b-487e-8d09-ee5cd01c5615-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:16 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e 1073741824" returned: 0 in 0.493s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:16 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:16 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e Apr 22 09:00:16 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:16 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Deleted volume successfully. Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7de6f4ca-f01f-4408-a5fd-d9f8ee66be76 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-c0de5fe9-96c3-476c-bf4e-466d49837981-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:16 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e" returned: 0 in 0.392s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca2dba9-0657-42c4-b36f-841b785f38e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb04a425-95db-423c-9f3e-1e782e51eb5e', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ad92bc-c5e6-4707-b17e-048890865c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:16 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Volume volume-bb04a425-95db-423c-9f3e-1e782e51eb5e (bb04a425-95db-423c-9f3e-1e782e51eb5e): created successfully Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ad92bc-c5e6-4707-b17e-048890865c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Flow 'volume_create_manager' (ef77e864-f276-4f41-8579-2ffba483ac25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:16 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b2193fcf-adca-4f21-88bb-012490d9eb74 tempest-VolumeQuotasAdminTestJSON-232484070 None] Created volume successfully. Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (4a1935f3-302c-4955-948b-a079d65eb3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f57451e-5ef1-40b1-8499-a653263b5bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f57451e-5ef1-40b1-8499-a653263b5bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1167465574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af13171e1ba04c7dacef0b9154e20365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:17Z,use_quota=True,user_id='31cafbc86b38400d82282579cbf40c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8cd581-9d13-4b4f-84c6-d9bbd351de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8cd581-9d13-4b4f-84c6-d9bbd351de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef7fa8b-cb07-45e7-be2b-d226af1132b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef7fa8b-cb07-45e7-be2b-d226af1132b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'volume_name': 'volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d28501-ea9e-487f-a21e-940d5ce1b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d28501-ea9e-487f-a21e-940d5ce1b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492e3ecc-0594-405b-beab-cac0b851e428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:16 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Volume 91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'volume_size': 1} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1167465574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af13171e1ba04c7dacef0b9154e20365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:17Z,use_quota=True,user_id='31cafbc86b38400d82282579cbf40c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Creating volume 91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:17 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:17 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd 1073741824 Apr 22 09:00:17 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:17 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd 1073741824" returned: 0 in 0.439s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:17 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:17 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "cinder-bb04a425-95db-423c-9f3e-1e782e51eb5e-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "cinder-bb04a425-95db-423c-9f3e-1e782e51eb5e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:17 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.412s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.844s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Creating offline snapshot 8dbd3afc-0815-4dc3-95c0-d3a2509854e1 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa855f9-d8e1-4c94-9e86-7e09d93696a9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "cinder-quobyte-bb04a425-95db-423c-9f3e-1e782e51eb5e" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492e3ecc-0594-405b-beab-cac0b851e428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a18163-f1b7-4479-a614-c7fabb9400f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "cinder-quobyte-bb04a425-95db-423c-9f3e-1e782e51eb5e" acquired by "delete_volume" :: waited 0.030s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:17 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Volume volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd (91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd): created successfully Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a18163-f1b7-4479-a614-c7fabb9400f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (4a1935f3-302c-4955-948b-a079d65eb3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[77899ec3-0e4f-48c0-9bcd-fd25d54b722b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:17 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ba3f4047-7b5f-484d-a5f1-cb8c68f90363 tempest-VolumeDependencyTests-2071264310 None] Created volume successfully. Apr 22 09:00:18 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:18 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:18 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e Apr 22 09:00:18 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:18 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.471s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:18 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 1G Apr 22 09:00:18 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:18 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e" returned: 0 in 0.465s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:18 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e Apr 22 09:00:18 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:18 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb04a425-95db-423c-9f3e-1e782e51eb5e" returned: 0 in 0.408s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "cinder-quobyte-bb04a425-95db-423c-9f3e-1e782e51eb5e" released by "delete_volume" :: held 0.903s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:18 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 1G" returned: 0 in 0.476s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Created reservations ['4e42d881-6bd3-4d18-a93e-0b348062225d', '721faf8f-e4b6-4701-bda0-5717c0b00789', '6676b44f-1111-424b-ac92-5a8d2af6d9cc', '03270586-1cde-411c-9be6-ae1a9eed940b'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:18 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 Apr 22 09:00:18 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:18 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:18 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Flow 'volume_create_manager' (beaff9a7-e2c6-48a5-8d23-3a690143b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fde7a00-6a49-4e92-a064-1b3db9a40480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fde7a00-6a49-4e92-a064-1b3db9a40480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1535785832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0372b041-4f65-42e7-ac7b-7caaa73e40a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2c8bad95114990aed86a66eb82e986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:19Z,use_quota=True,user_id='abe0c8c27eed4e90952446ef0680b7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d7b24b-576c-4172-ac45-477a5a199cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d7b24b-576c-4172-ac45-477a5a199cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd71702-db90-4daf-87c8-b4c5d3f6839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd71702-db90-4daf-87c8-b4c5d3f6839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0372b041-4f65-42e7-ac7b-7caaa73e40a4', 'volume_name': 'volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770aa887-d413-42ff-a78a-1aa2f72e761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770aa887-d413-42ff-a78a-1aa2f72e761f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aeedc5-047b-4b91-b654-96dea4d025d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Volume 0372b041-4f65-42e7-ac7b-7caaa73e40a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4', 'volume_size': 1} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:19 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1" returned: 0 in 0.477s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:19 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 is being set with open permissions: ugo+rw Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:19 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 Apr 22 09:00:19 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:19 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Deleted volume successfully. Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (b9e23e85-0a33-4994-9131-5c2c31649fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f5cabd-8160-435a-b3db-4d38a7b9538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6e6e4a44-9f4c-4222-94ec-50a8ac62aca5 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "cinder-bb04a425-95db-423c-9f3e-1e782e51eb5e-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f5cabd-8160-435a-b3db-4d38a7b9538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583009964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c56410a-9c2b-422b-abd8-fcabc1a0d07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af13171e1ba04c7dacef0b9154e20365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:19Z,use_quota=True,user_id='31cafbc86b38400d82282579cbf40c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07764ca0-961d-4a88-8880-5633b79af6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07764ca0-961d-4a88-8880-5633b79af6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c259ae0-c56f-4998-bf66-7eb5725c1173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c259ae0-c56f-4998-bf66-7eb5725c1173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3c56410a-9c2b-422b-abd8-fcabc1a0d07d', 'volume_name': 'volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d', 'volume_size': 1, 'source_volid': '91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700ae640-7672-4bee-a21d-2e74bac03e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700ae640-7672-4bee-a21d-2e74bac03e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7240faf3-fac4-44c5-9c96-3b5cdd039178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:19 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Volume 3c56410a-9c2b-422b-abd8-fcabc1a0d07d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d', 'volume_size': 1, 'source_volid': '91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'source_volstatus': 'available'} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:19 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1" returned: 0 in 0.411s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1535785832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0372b041-4f65-42e7-ac7b-7caaa73e40a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2c8bad95114990aed86a66eb82e986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:19Z,use_quota=True,user_id='abe0c8c27eed4e90952446ef0680b7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Creating volume 0372b041-4f65-42e7-ac7b-7caaa73e40a4 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:19 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:19 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 1073741824 Apr 22 09:00:19 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d1fc8c29-28f5-4916-ac65-0aff6ce7a381 tempest-SnapshotsActionsTest-382711650 None] Create snapshot completed successfully Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-8dbd3afc-0815-4dc3-95c0-d3a2509854e1-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-8dbd3afc-0815-4dc3-95c0-d3a2509854e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Acquiring lock "cinder-quobyte-8dbd3afc-0815-4dc3-95c0-d3a2509854e1" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-8dbd3afc-0815-4dc3-95c0-d3a2509854e1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Deleting offline snapshot 8dbd3afc-0815-4dc3-95c0-d3a2509854e1 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] snapshot_file for this snap is: volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[358ce98e-a587-4c29-8dd7-2162a32fbe33]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:20 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 1073741824" returned: 0 in 0.474s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:20 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 Apr 22 09:00:20 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:20 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 Apr 22 09:00:20 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:20 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5f94d-c7ea-46ba-9233-5f982c9397d7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:20 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4" returned: 0 in 0.411s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.168s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:20 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Cloning volume 91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd to volume 3c56410a-9c2b-422b-abd8-fcabc1a0d07d Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aeedc5-047b-4b91-b654-96dea4d025d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aef9f33-86dc-4104-aa84-3bf9c42dba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:20 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Volume volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 (0372b041-4f65-42e7-ac7b-7caaa73e40a4): created successfully Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aef9f33-86dc-4104-aa84-3bf9c42dba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Flow 'volume_create_manager' (beaff9a7-e2c6-48a5-8d23-3a690143b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Creating offline snapshot da29aabd-df02-43b3-abab-8fb8b729dbd3 of volume 91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:00:20 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:20 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e0df729c-a6a4-4bbf-8cfb-463e4ba44d41 tempest-VolumeQuotasAdminTestJSON-232484070 None] Created volume successfully. Apr 22 09:00:20 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae1d3f4-3c78-43b3-9095-fafaa4e4a70c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:20 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:20 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:21 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.449s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:21 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 Apr 22 09:00:21 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:21 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.478s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:21 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 1G Apr 22 09:00:21 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:21 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1" returned: 0 in 0.523s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:21 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1 Apr 22 09:00:21 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:21 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 1G" returned: 0 in 0.530s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:21 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 Apr 22 09:00:21 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-700bdcc8-881e-464f-937b-fbdb05a8456e tempest-VolumeQuotasAdminTestJSON-1326960940 None] Transfer volume completed successfully. Apr 22 09:00:22 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.8dbd3afc-0815-4dc3-95c0-d3a2509854e1" returned: 0 in 0.416s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-8dbd3afc-0815-4dc3-95c0-d3a2509854e1" released by "_delete_snapshot" :: held 1.892s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" released by "delete_snapshot" :: held 1.906s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Created reservations ['aa575f19-d858-40e3-a754-10f87f2105c2', '6a00e201-c3b0-422b-b0c7-95cb0692189b', '01536373-b7d3-4d01-bdd2-6b5dc8f242a7', '8cfb498a-7506-49ca-b48f-27d4aadb71e3'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:22 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Delete snapshot completed successfully. Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e8a5fc74-8915-4c1c-9f6a-5cbb2674be6c tempest-SnapshotsActionsTest-1468287694 None] Lock "cinder-8dbd3afc-0815-4dc3-95c0-d3a2509854e1-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:22 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3" returned: 0 in 0.425s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:22 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 is being set with open permissions: ugo+rw Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:22 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 Apr 22 09:00:22 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Acquiring lock "cinder-0372b041-4f65-42e7-ac7b-7caaa73e40a4-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Lock "cinder-0372b041-4f65-42e7-ac7b-7caaa73e40a4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "cinder-ac515eaf-1e8a-464c-b94b-8140a68fb8d1-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:22 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Acquiring lock "cinder-quobyte-0372b041-4f65-42e7-ac7b-7caaa73e40a4" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-ac515eaf-1e8a-464c-b94b-8140a68fb8d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "cinder-quobyte-ac515eaf-1e8a-464c-b94b-8140a68fb8d1" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Lock "cinder-quobyte-0372b041-4f65-42e7-ac7b-7caaa73e40a4" acquired by "delete_volume" :: waited 0.033s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:22 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info Apr 22 09:00:22 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5c0f9a-2001-4a55-9b95-ba1e9fa216b3]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-quobyte-ac515eaf-1e8a-464c-b94b-8140a68fb8d1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Deleting offline snapshot ac515eaf-1e8a-464c-b94b-8140a68fb8d1 of volume 25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] snapshot_file for this snap is: volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf11f642-0166-4703-a9b5-94d85db7dac5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:22 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 Apr 22 09:00:22 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:22 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:22 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:23 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info" returned: 0 in 0.414s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:23 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info is being set with open permissions: ugo+rw Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:23 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info Apr 22 09:00:23 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:23 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4" returned: 0 in 0.471s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:23 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:23 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4 Apr 22 09:00:23 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a23252-5392-4c97-9659-08ee67f10bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f0cfdc-b233-4133-8a2e-853109eff725]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:23 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 Apr 22 09:00:23 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:23 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.info" returned: 0 in 0.398s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] snapshot: da29aabd-df02-43b3-abab-8fb8b729dbd3, volume: 3c56410a-9c2b-422b-abd8-fcabc1a0d07d, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[34468d9e-4ec9-41a8-bb14-9f7e7a3404a7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:23 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-0372b041-4f65-42e7-ac7b-7caaa73e40a4" returned: 0 in 0.412s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:23 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 Apr 22 09:00:23 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Lock "cinder-quobyte-0372b041-4f65-42e7-ac7b-7caaa73e40a4" released by "delete_volume" :: held 0.904s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Created reservations ['4fc00645-f6da-44a6-bddb-09330bf1e0ab', 'd630148e-1583-4122-8893-062ee1baacab', '3cfe1f2e-fef3-43b8-a685-e975202d5c1c', '6b152f65-01f5-402f-aed0-7bceb033217d'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:23 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:23 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:23 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:23 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:23 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:24 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3" returned: 0 in 0.569s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0496c1-ab6c-40ee-a87a-13fffe10e24d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:24 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:24 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:24 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.536s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:24 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Deleted volume successfully. Apr 22 09:00:24 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.525s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f744865c-0c8c-45f5-aba2-e83d51a11294 tempest-VolumeQuotasAdminTestJSON-1546999544 None] Lock "cinder-0372b041-4f65-42e7-ac7b-7caaa73e40a4-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:24 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1 Apr 22 09:00:24 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:24 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.564s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:24 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d Apr 22 09:00:24 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:24 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1.ac515eaf-1e8a-464c-b94b-8140a68fb8d1" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-quobyte-ac515eaf-1e8a-464c-b94b-8140a68fb8d1" released by "_delete_snapshot" :: held 2.039s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" released by "delete_snapshot" :: held 2.066s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Created reservations ['76d67838-9fd5-4afa-9e00-30042a8aba46', '585b711a-da0f-4001-acd2-194a545d54b9', 'c6ad26f2-a3e7-4a04-9bc2-49539776e09e', 'e1177444-7532-448c-a281-07f5acdd5eed'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:24 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Delete snapshot completed successfully. Apr 22 09:00:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-633b6865-c52d-4daf-8acc-b7a118c875fb tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-ac515eaf-1e8a-464c-b94b-8140a68fb8d1-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "cinder-25a23252-5392-4c97-9659-08ee67f10bf1-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-25a23252-5392-4c97-9659-08ee67f10bf1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" acquired by "delete_volume" :: waited 0.029s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461f8cb-2796-4e3c-90a3-465078fd9cc7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:26 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 Apr 22 09:00:26 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:27 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" returned: 0 in 2.354s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8a5b31-9cbb-4c06-a3bf-ddd2a0eb4ead]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:27 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:27 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:27 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1" returned: 0 in 0.898s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:27 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1 Apr 22 09:00:27 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:27 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.706s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:00:27 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Converted 1024.00 MB image at 434.81 MB/s Apr 22 09:00:27 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d is being set with open permissions: ugo+rw Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:27 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d Apr 22 09:00:27 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:27 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-25a23252-5392-4c97-9659-08ee67f10bf1" returned: 0 in 0.479s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-quobyte-25a23252-5392-4c97-9659-08ee67f10bf1" released by "delete_volume" :: held 1.436s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:DELETE=17,cinder:UPDATE=229,cinder:INSERT=52,cinder:SELECT=201 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Created reservations ['2cd732b4-883d-4c4b-8b3d-18e70ad57d62', 'f0036835-2aed-4288-83b5-d22c6ed96480', 'db86c418-653e-49fb-a132-d832ed4001d3', 'b69b479b-ceeb-42f0-ada0-2e626997496c'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:27 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:27 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:28 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" released by "_copy_volume_from_snapshot" :: held 4.711s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-da29aabd-df02-43b3-abab-8fb8b729dbd3" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-da29aabd-df02-43b3-abab-8fb8b729dbd3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Deleting offline snapshot da29aabd-df02-43b3-abab-8fb8b729dbd3 of volume 91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] snapshot_file for this snap is: volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fdb849-8537-4729-816d-c0bd556c0a02]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:28 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 Apr 22 09:00:28 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:28 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:28 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Deleted volume successfully. Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f308dc91-aa88-4ef8-9640-9ee3484f332b tempest-SnapshotsActionsTest-382711650 None] Lock "cinder-25a23252-5392-4c97-9659-08ee67f10bf1-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:28 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3" returned: 0 in 0.542s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e0addf-b74b-452c-b3c0-6a6100435f3c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:28 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:28 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:29 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.586s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:29 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 Apr 22 09:00:29 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:29 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3" returned: 0 in 0.563s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:29 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3 Apr 22 09:00:29 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:30 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd.da29aabd-df02-43b3-abab-8fb8b729dbd3" returned: 0 in 0.473s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-da29aabd-df02-43b3-abab-8fb8b729dbd3" released by "_delete_snapshot" :: held 2.213s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.763s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7240faf3-fac4-44c5-9c96-3b5cdd039178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d', 'volume_size': 1, 'source_volid': '91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af8be3a-8160-4826-b746-818f6d11b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Volume volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d (3c56410a-9c2b-422b-abd8-fcabc1a0d07d): created successfully Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af8be3a-8160-4826-b746-818f6d11b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Flow 'volume_create_manager' (b9e23e85-0a33-4994-9131-5c2c31649fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:30 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4e292195-9d98-49e7-9513-3e0cc482ef80 tempest-VolumeDependencyTests-2071264310 None] Created volume successfully. Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3cee19-5df1-4e36-a88c-625584aa7640]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:31 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:31 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:31 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.569s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:31 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd Apr 22 09:00:31 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:32 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" returned: 0 in 0.522s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd" released by "delete_volume" :: held 1.120s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Created reservations ['f0f1b9cd-78d8-4030-9456-642ce5f9aa6b', '2c9f2cc5-957e-4880-a43c-16f1dfe1c991', '5b80f56d-9ab6-4a88-81b6-8fdb137dfd80', 'bf22b7fe-d6fd-42f1-b778-ce053feda9a0'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:32 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:32 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:32 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.429s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Deleted volume successfully. Apr 22 09:00:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-03dedcf8-728f-4dc1-aa13-cec2a9ff3128 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-91a6a91e-c8ee-4a7b-8207-9e5eda7d5dbd-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-3c56410a-9c2b-422b-abd8-fcabc1a0d07d-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-3c56410a-9c2b-422b-abd8-fcabc1a0d07d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6f1c17-f1c5-4171-90b2-dc78c50b571b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:33 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d Apr 22 09:00:33 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:33 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" returned: 0 in 0.518s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:33 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d Apr 22 09:00:33 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:34 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" returned: 0 in 0.434s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-3c56410a-9c2b-422b-abd8-fcabc1a0d07d" released by "delete_volume" :: held 0.987s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Created reservations ['e0f0ce50-b537-4e32-a92f-97bbdf24a7cc', 'f5950563-d495-4f57-96ed-3ef1990f1fc6', '372a8863-fbbc-4d7f-be6f-bd3ff92ab5a2', '8ea8158c-bd4a-46a2-b77e-38b604ed212e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:34 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:34 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:34 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Deleted volume successfully. Apr 22 09:00:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ef37c5ef-fbad-4506-ad5c-6389bb8e413a tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-3c56410a-9c2b-422b-abd8-fcabc1a0d07d-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-da31dbfa-49a1-4e06-9b63-b21cf0665414-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-da31dbfa-49a1-4e06-9b63-b21cf0665414-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "cinder-quobyte-da31dbfa-49a1-4e06-9b63-b21cf0665414" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-da31dbfa-49a1-4e06-9b63-b21cf0665414" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:35 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748c365-fa7e-42b2-bad3-a0f95fd4f079]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:35 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 Apr 22 09:00:35 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:36 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414" returned: 0 in 0.600s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:36 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414 Apr 22 09:00:36 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:36 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-da31dbfa-49a1-4e06-9b63-b21cf0665414" returned: 0 in 0.526s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-quobyte-da31dbfa-49a1-4e06-9b63-b21cf0665414" released by "delete_volume" :: held 1.151s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Created reservations ['34438505-b273-4b16-a9b2-dedca7693237', '83ba2381-15b5-4b7d-ad0d-f9230fc0d98b', 'a2ea6d20-8462-4f7a-ae08-1448b8a99843', '31b3f99e-adc3-44ee-bdab-77e7cc88a92f'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:36 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:36 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:37 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:37 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Deleted volume successfully. Apr 22 09:00:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-febf08d8-29b4-4413-889f-3c7457d67607 tempest-VolumeDependencyTests-2071264310 None] Lock "cinder-da31dbfa-49a1-4e06-9b63-b21cf0665414-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:DELETE=16,cinder:UPDATE=219,cinder:SELECT=181,cinder:INSERT=57 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Flow 'volume_create_manager' (6983547c-1cbd-4544-a129-620ac4a35780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a804738e-113f-4a91-999a-0d4ae4cff5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a804738e-113f-4a91-999a-0d4ae4cff5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d888de25b5e4ccd90b70e8a1b8794b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:40Z,use_quota=True,user_id='fbd6c402a554455da33cafdae185f924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6187da-db0c-4d95-b013-d26d2f2d364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6187da-db0c-4d95-b013-d26d2f2d364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577a8e3d-b8da-487f-9b39-d80ff4c3caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577a8e3d-b8da-487f-9b39-d80ff4c3caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb', 'volume_name': 'volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7dcfa3-4062-4de1-93d6-92c5fdd9f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7dcfa3-4062-4de1-93d6-92c5fdd9f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64133d5b-61de-419c-bfbb-70891c4d1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:40 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Volume 99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb', 'volume_size': 1} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d888de25b5e4ccd90b70e8a1b8794b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:40Z,use_quota=True,user_id='fbd6c402a554455da33cafdae185f924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Creating volume 99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:40 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:40 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb 1073741824 Apr 22 09:00:40 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:40 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb 1073741824" returned: 0 in 0.654s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:41 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb Apr 22 09:00:41 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:41 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64133d5b-61de-419c-bfbb-70891c4d1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c6e4d7-75a8-46e5-b18c-fef21071b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Volume volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb (99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb): created successfully Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c6e4d7-75a8-46e5-b18c-fef21071b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Flow 'volume_create_manager' (6983547c-1cbd-4544-a129-620ac4a35780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-01777128-b143-44ab-8ebf-40cf05cbde8a tempest-CinderUnicodeTest-1443781238 None] Created volume successfully. Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Flow 'volume_create_manager' (b477e504-676d-49dd-a4e9-27ac2525c595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0335bf1-3106-4f38-989c-051588d9af31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0335bf1-3106-4f38-989c-051588d9af31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-83791296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9a8a47-1cb0-4dcb-bd02-fe9963cba293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324bb71be8b7407f8d576eaaa308b480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:42Z,use_quota=True,user_id='f613bdf7eb4b4d879ca775c23f87431c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9af80be7-412a-4962-b4e0-038c9e5056ff),volume_type_id=9af80be7-412a-4962-b4e0-038c9e5056ff)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9915c55e-76d3-4742-8abe-f40ff8e47caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9915c55e-76d3-4742-8abe-f40ff8e47caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a60564-1877-414a-8cf0-1b88972d6c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a60564-1877-414a-8cf0-1b88972d6c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9a8a47-1cb0-4dcb-bd02-fe9963cba293', 'volume_name': 'volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d72ba61-7505-42c5-b7d7-ff0d667920d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d72ba61-7505-42c5-b7d7-ff0d667920d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879379d9-79bf-4363-a88e-641af7c7ddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Volume df9a8a47-1cb0-4dcb-bd02-fe9963cba293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293', 'volume_size': 1} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-83791296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9a8a47-1cb0-4dcb-bd02-fe9963cba293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324bb71be8b7407f8d576eaaa308b480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:42Z,use_quota=True,user_id='f613bdf7eb4b4d879ca775c23f87431c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9af80be7-412a-4962-b4e0-038c9e5056ff),volume_type_id=9af80be7-412a-4962-b4e0-038c9e5056ff)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Creating volume df9a8a47-1cb0-4dcb-bd02-fe9963cba293 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:42 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:42 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 1073741824 Apr 22 09:00:42 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Flow 'volume_create_manager' (014e2d89-dc96-49fd-90f7-458457c779ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9cc7ae-308d-4f92-8602-a4d37a80fe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9cc7ae-308d-4f92-8602-a4d37a80fe8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1757949603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88c3c07-f712-466c-b0dd-d2df5ab572c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d888de25b5e4ccd90b70e8a1b8794b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:43Z,use_quota=True,user_id='fbd6c402a554455da33cafdae185f924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d446b8cf-6966-4acf-9315-005859638b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d446b8cf-6966-4acf-9315-005859638b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055094f7-4f12-4028-8807-2cb47252ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055094f7-4f12-4028-8807-2cb47252ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88c3c07-f712-466c-b0dd-d2df5ab572c9', 'volume_name': 'volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d740429-d760-4488-839d-14221249ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d740429-d760-4488-839d-14221249ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879c1d2f-fc20-45da-b808-feb0f222bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Volume e88c3c07-f712-466c-b0dd-d2df5ab572c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9', 'volume_size': 1} Apr 22 09:00:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:43 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 1073741824" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:43 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 Apr 22 09:00:43 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:43 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1757949603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88c3c07-f712-466c-b0dd-d2df5ab572c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d888de25b5e4ccd90b70e8a1b8794b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:43Z,use_quota=True,user_id='fbd6c402a554455da33cafdae185f924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Creating volume e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:43 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879379d9-79bf-4363-a88e-641af7c7ddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:43 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 1073741824 Apr 22 09:00:43 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ad2637-5cc5-4b6e-ab43-9fc5ad8525c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Volume volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 (df9a8a47-1cb0-4dcb-bd02-fe9963cba293): created successfully Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ad2637-5cc5-4b6e-ab43-9fc5ad8525c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Flow 'volume_create_manager' (b477e504-676d-49dd-a4e9-27ac2525c595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2bd0526d-d281-43d7-99c9-a54bfaac11ec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Created volume successfully. Apr 22 09:00:44 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 1073741824" returned: 0 in 0.532s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:44 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 Apr 22 09:00:44 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:44 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879c1d2f-fc20-45da-b808-feb0f222bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caa2323-8f1a-4c4a-ae77-3af3f6bd9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:44 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Volume volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 (e88c3c07-f712-466c-b0dd-d2df5ab572c9): created successfully Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caa2323-8f1a-4c4a-ae77-3af3f6bd9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Flow 'volume_create_manager' (014e2d89-dc96-49fd-90f7-458457c779ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:44 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d7742809-ac56-42f9-a16d-01a049a66057 tempest-CinderUnicodeTest-1443781238 None] Created volume successfully. Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:44 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:44 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Creating offline snapshot 51b1e663-3769-46bc-9999-5493683f0b3f of volume e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e586e-c7a2-4b8f-857c-bcb6c0916e1f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:45 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 Apr 22 09:00:45 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:45 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.465s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:45 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-055dac31-711a-4f37-a0ed-f6ddd7b20dec tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Retype volume completed successfully. Apr 22 09:00:45 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9" returned: 0 in 0.536s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:45 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f 1G Apr 22 09:00:45 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:46 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f 1G" returned: 0 in 0.585s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:46 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f Apr 22 09:00:46 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Acquiring lock "cinder-df9a8a47-1cb0-4dcb-bd02-fe9963cba293-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "cinder-df9a8a47-1cb0-4dcb-bd02-fe9963cba293-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Acquiring lock "cinder-quobyte-df9a8a47-1cb0-4dcb-bd02-fe9963cba293" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "cinder-quobyte-df9a8a47-1cb0-4dcb-bd02-fe9963cba293" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1c2d40-e5e4-48f3-b1cd-0362b4976ef5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:46 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 Apr 22 09:00:46 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:46 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:46 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f is being set with open permissions: ugo+rw Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:46 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f Apr 22 09:00:46 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:46 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293" returned: 0 in 0.519s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:46 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293 Apr 22 09:00:46 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:47 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f" returned: 0 in 0.545s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:47 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info Apr 22 09:00:47 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:47 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-df9a8a47-1cb0-4dcb-bd02-fe9963cba293" returned: 0 in 0.482s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "cinder-quobyte-df9a8a47-1cb0-4dcb-bd02-fe9963cba293" released by "delete_volume" :: held 1.036s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:47 devstack cinder-volume[83774]: WARNING cinder.quota [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:00:47 devstack cinder-volume[83774]: WARNING cinder.quota [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Created reservations ['46bd9221-b500-44a7-894e-f99d0d1ecf09', '129b882a-9f1a-4b92-aab3-4257d1f64068', '040333a7-188a-457b-ab31-a352d3a3c6b0', '78c9ee7b-caa7-40d3-a043-ec751dfc63ca'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:47 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:47 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:47 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:47 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info is being set with open permissions: ugo+rw Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:47 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info Apr 22 09:00:47 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:47 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:47 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Deleted volume successfully. Apr 22 09:00:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a877b55a-ea82-41ba-8688-9b93549ed6bb tempest-VolumeRetypeWithoutMigrationTest-923322293 None] Lock "cinder-df9a8a47-1cb0-4dcb-bd02-fe9963cba293-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:48 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.info" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:48 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-66553bc2-a492-44b7-bdec-4ca27fbcb960 tempest-CinderUnicodeTest-1443781238 None] Create snapshot completed successfully Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-51b1e663-3769-46bc-9999-5493683f0b3f-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-51b1e663-3769-46bc-9999-5493683f0b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-quobyte-e88c3c07-f712-466c-b0dd-d2df5ab572c9" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-e88c3c07-f712-466c-b0dd-d2df5ab572c9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-quobyte-51b1e663-3769-46bc-9999-5493683f0b3f" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-51b1e663-3769-46bc-9999-5493683f0b3f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Deleting offline snapshot 51b1e663-3769-46bc-9999-5493683f0b3f of volume e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] snapshot_file for this snap is: volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f636c31c-1f5e-40ec-bb96-2b2abbb337df]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:49 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f Apr 22 09:00:49 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:49 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f" returned: 0 in 0.630s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd4579-afc1-4f8b-bde7-786d30a16e16]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:49 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 Apr 22 09:00:49 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:50 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9" returned: 0 in 0.617s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:50 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f Apr 22 09:00:50 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:51 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f" returned: 0 in 0.531s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:51 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f Apr 22 09:00:51 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:51 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9.51b1e663-3769-46bc-9999-5493683f0b3f" returned: 0 in 0.579s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-51b1e663-3769-46bc-9999-5493683f0b3f" released by "_delete_snapshot" :: held 2.430s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-e88c3c07-f712-466c-b0dd-d2df5ab572c9" released by "delete_snapshot" :: held 2.448s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Created reservations ['2e520732-fa3e-48dd-b93a-19a9f803acee', 'a0c0f68d-42a2-4841-a968-dae51dea1884', '60d2f155-e9f4-442b-a26f-19cb5548b1c0', '882aa8b2-27c3-468d-9c76-ffe03a8594d8'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:51 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Delete snapshot completed successfully. Apr 22 09:00:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b5f126b4-2c95-4ce6-8095-17163fb554c6 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-51b1e663-3769-46bc-9999-5493683f0b3f-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Flow 'volume_create_manager' (134a91bb-2b22-48ba-8a5e-4bbc353354bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bd3fcb-7b13-44bb-958d-88f75b07c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bd3fcb-7b13-44bb-958d-88f75b07c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2052964069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bcaaf1-a34f-413e-b007-792c3ac34dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efbfaf099f36461cbfe6f2297de5a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:52Z,use_quota=True,user_id='aa455ab029154f588bd92f86c88d15f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74f990c-5ba6-4ece-8c52-a17eac142b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74f990c-5ba6-4ece-8c52-a17eac142b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ac85a7-440a-4b55-9e0b-e0e0897e30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ac85a7-440a-4b55-9e0b-e0e0897e30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bcaaf1-a34f-413e-b007-792c3ac34dd8', 'volume_name': 'volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a92531-9fac-490c-a37c-bd9364a37fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a92531-9fac-490c-a37c-bd9364a37fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f46851-6e20-4a31-988a-8f1074580f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:52 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Volume e0bcaaf1-a34f-413e-b007-792c3ac34dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8', 'volume_size': 1} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2052964069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bcaaf1-a34f-413e-b007-792c3ac34dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efbfaf099f36461cbfe6f2297de5a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:00:52Z,use_quota=True,user_id='aa455ab029154f588bd92f86c88d15f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Creating volume e0bcaaf1-a34f-413e-b007-792c3ac34dd8 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:00:52 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:52 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 1073741824 Apr 22 09:00:52 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-e88c3c07-f712-466c-b0dd-d2df5ab572c9-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-e88c3c07-f712-466c-b0dd-d2df5ab572c9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-quobyte-e88c3c07-f712-466c-b0dd-d2df5ab572c9" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-e88c3c07-f712-466c-b0dd-d2df5ab572c9" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3240c2-375c-4887-aabc-ab6a5c6ecdc5]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:52 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 Apr 22 09:00:52 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:52 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 1073741824" returned: 0 in 0.534s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:52 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 Apr 22 09:00:52 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:52 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9" returned: 0 in 0.581s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:52 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9 Apr 22 09:00:52 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:53 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f46851-6e20-4a31-988a-8f1074580f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430ddc37-adb5-4522-bb0e-01f1cab84b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:00:53 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Volume volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 (e0bcaaf1-a34f-413e-b007-792c3ac34dd8): created successfully Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430ddc37-adb5-4522-bb0e-01f1cab84b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Flow 'volume_create_manager' (134a91bb-2b22-48ba-8a5e-4bbc353354bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:00:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d68fcb34-6520-4c8e-aabd-7e695d9a5b04 tempest-VolumesServicesTestJSON-1900103678 None] Created volume successfully. Apr 22 09:00:53 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e88c3c07-f712-466c-b0dd-d2df5ab572c9" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-e88c3c07-f712-466c-b0dd-d2df5ab572c9" released by "delete_volume" :: held 1.073s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Created reservations ['8007fe63-e580-497e-aa98-c586e622bb88', '68c6825d-f523-448b-b752-8c43122dfc09', '44410b56-9a87-4945-9759-93d8735247b0', '53ef13aa-d8f6-4c84-b0cb-19a28807dbcb'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:53 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:53 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:53 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.429s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Deleted volume successfully. Apr 22 09:00:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d9d9929b-65d2-4445-a1e5-6c072cccafdf tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-e88c3c07-f712-466c-b0dd-d2df5ab572c9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Acquiring lock "cinder-e0bcaaf1-a34f-413e-b007-792c3ac34dd8-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Lock "cinder-e0bcaaf1-a34f-413e-b007-792c3ac34dd8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Acquiring lock "cinder-quobyte-e0bcaaf1-a34f-413e-b007-792c3ac34dd8" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Lock "cinder-quobyte-e0bcaaf1-a34f-413e-b007-792c3ac34dd8" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5272b9f5-1e0c-4ce3-933b-410ee3c00cae]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:54 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 Apr 22 09:00:54 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "cinder-quobyte-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce20cba-1c72-459f-843f-723db1d36201]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:54 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb Apr 22 09:00:54 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:54 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8" returned: 0 in 0.481s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:54 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8 Apr 22 09:00:54 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:55 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb" returned: 0 in 0.516s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:55 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb Apr 22 09:00:55 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:55 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e0bcaaf1-a34f-413e-b007-792c3ac34dd8" returned: 0 in 0.428s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Lock "cinder-quobyte-e0bcaaf1-a34f-413e-b007-792c3ac34dd8" released by "delete_volume" :: held 0.939s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Created reservations ['666abbe6-0fd5-4da0-96bf-136c140a2a67', 'ec273372-2b89-4a05-b360-4b576a299f5a', 'c34ef2e9-c129-43de-bebe-2ad092392215', '4fc0dabb-1d3c-4560-9331-cf4bdcd83cac'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:55 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:55 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:55 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-quobyte-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb" released by "delete_volume" :: held 0.993s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Created reservations ['c81e1ea5-5a01-405b-aa3a-8c66ec750db0', 'be2af985-b867-4b19-994f-3cfd02464210', 'c98ac2a2-08ad-4e8f-a63b-2160bc6fb184', '76044639-bf7b-463e-a7b4-fe35cbad25e9'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:00:55 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:00:55 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:00:55 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.518s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Deleted volume successfully. Apr 22 09:00:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-740db559-6b7d-4882-bdfc-ac8725feb39c tempest-VolumesServicesTestJSON-1900103678 None] Lock "cinder-e0bcaaf1-a34f-413e-b007-792c3ac34dd8-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:00:56 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 22 09:00:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.483s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:00:56 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:00:56 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Deleted volume successfully. Apr 22 09:00:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e6b62972-1f7e-4565-97f5-dac795ca89d9 tempest-CinderUnicodeTest-1443781238 None] Lock "cinder-99c04bbc-1fb9-4a65-9e1d-16bcdb5b76eb-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:05 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=45,cinder:INSERT=16,cinder:UPDATE=47,cinder:DELETE=7 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:01:06 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=60,cinder:INSERT=18,cinder:UPDATE=96,cinder:DELETE=4 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (52a91e66-2189-4403-b0ac-5e93de3e2793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6818b872-c79f-4fc0-a379-e68ffe6299da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6818b872-c79f-4fc0-a379-e68ffe6299da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211520875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211faee7-32c3-47e4-96e7-cb845d583078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:07Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3da7f4-6388-4a06-8b7c-5d060e1cb2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3da7f4-6388-4a06-8b7c-5d060e1cb2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcdec1a-adb7-4a3b-b796-c1aaca1bd05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcdec1a-adb7-4a3b-b796-c1aaca1bd05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211faee7-32c3-47e4-96e7-cb845d583078', 'volume_name': 'volume-211faee7-32c3-47e4-96e7-cb845d583078', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4fcb7c-1ad6-439f-8093-535969f87dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4fcb7c-1ad6-439f-8093-535969f87dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e0d0bf-a8b7-40d4-9035-d716ccd7b3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:07 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Volume 211faee7-32c3-47e4-96e7-cb845d583078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211faee7-32c3-47e4-96e7-cb845d583078', 'volume_size': 1} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211520875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211faee7-32c3-47e4-96e7-cb845d583078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:07Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Creating volume 211faee7-32c3-47e4-96e7-cb845d583078 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:07 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:07 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 1073741824 Apr 22 09:01:07 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:07 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 1073741824" returned: 0 in 0.590s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:08 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 Apr 22 09:01:08 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:08 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078" returned: 0 in 0.453s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e0d0bf-a8b7-40d4-9035-d716ccd7b3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211faee7-32c3-47e4-96e7-cb845d583078', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619fb41c-dcc7-4d4e-8fef-c62f7356a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:08 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Volume volume-211faee7-32c3-47e4-96e7-cb845d583078 (211faee7-32c3-47e4-96e7-cb845d583078): created successfully Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619fb41c-dcc7-4d4e-8fef-c62f7356a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (52a91e66-2189-4403-b0ac-5e93de3e2793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5517d115-1d1e-4396-8431-804f3269a57c tempest-VolumesActionsTest-852218628 None] Created volume successfully. Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Flow 'volume_create_manager' (63889e19-ccb2-4580-84dc-eea406ca2611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e090b67f-2a64-4dee-9c44-8b328912eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e090b67f-2a64-4dee-9c44-8b328912eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-379609344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9076656-2dfd-4e8e-8d7a-3768264b3716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d044bd2413634c719ce20234cc1e21f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:09Z,use_quota=True,user_id='b668db82539842f18cf1b9d74d545101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c07d1-5f0a-4290-8ba4-ceb19c372325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c07d1-5f0a-4290-8ba4-ceb19c372325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f7f24b-208b-4426-a9ab-d4a528ba4281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f7f24b-208b-4426-a9ab-d4a528ba4281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9076656-2dfd-4e8e-8d7a-3768264b3716', 'volume_name': 'volume-b9076656-2dfd-4e8e-8d7a-3768264b3716', 'volume_size': 2}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcbeae3-4320-450b-a817-12350432385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcbeae3-4320-450b-a817-12350432385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e98d7cb-b85a-435e-a856-5eac13c309e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:08 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Volume b9076656-2dfd-4e8e-8d7a-3768264b3716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9076656-2dfd-4e8e-8d7a-3768264b3716', 'volume_size': 2} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-379609344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9076656-2dfd-4e8e-8d7a-3768264b3716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d044bd2413634c719ce20234cc1e21f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:09Z,use_quota=True,user_id='b668db82539842f18cf1b9d74d545101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Creating volume b9076656-2dfd-4e8e-8d7a-3768264b3716 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:08 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 2147483648 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:08 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 2147483648 Apr 22 09:01:08 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:09 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 2147483648" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:09 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 Apr 22 09:01:09 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c0b33fff-ffc3-49bc-88c4-7a629ded0bed tempest-VolumesActionsTest-852218628 None] Acquiring lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078" by "attach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c0b33fff-ffc3-49bc-88c4-7a629ded0bed tempest-VolumesActionsTest-852218628 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078" acquired by "attach_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c0b33fff-ffc3-49bc-88c4-7a629ded0bed tempest-VolumesActionsTest-852218628 None] Attaching volume 211faee7-32c3-47e4-96e7-cb845d583078 to instance 82ea67b2-5ff6-41b6-9e17-734dc92b1437 at mountpoint /dev/vdb on host None. Apr 22 09:01:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c0b33fff-ffc3-49bc-88c4-7a629ded0bed tempest-VolumesActionsTest-852218628 None] Attach volume completed successfully. Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c0b33fff-ffc3-49bc-88c4-7a629ded0bed tempest-VolumesActionsTest-852218628 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078" released by "attach_volume" :: held 0.053s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:09 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e98d7cb-b85a-435e-a856-5eac13c309e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9076656-2dfd-4e8e-8d7a-3768264b3716', 'volume_size': 2}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf22136-9621-4095-b120-9326e9bdc4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:09 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Volume volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 (b9076656-2dfd-4e8e-8d7a-3768264b3716): created successfully Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf22136-9621-4095-b120-9326e9bdc4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Flow 'volume_create_manager' (63889e19-ccb2-4580-84dc-eea406ca2611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-669a9373-64a3-4d7a-a61e-6de46b358b0f tempest-VolumesCloneNegativeTest-2035619202 None] Created volume successfully. Apr 22 09:01:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2771f482-7acf-489e-beb0-dc3afeaa7351 tempest-VolumesActionsTest-1390294567 None] Terminate volume connection completed successfully. Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2771f482-7acf-489e-beb0-dc3afeaa7351 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-detach_volume" by "detach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2771f482-7acf-489e-beb0-dc3afeaa7351 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2771f482-7acf-489e-beb0-dc3afeaa7351 tempest-VolumesActionsTest-1390294567 None] Detaching volume 211faee7-32c3-47e4-96e7-cb845d583078 from instance 82ea67b2-5ff6-41b6-9e17-734dc92b1437. Apr 22 09:01:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2771f482-7acf-489e-beb0-dc3afeaa7351 tempest-VolumesActionsTest-1390294567 None] Detach volume completed successfully. Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2771f482-7acf-489e-beb0-dc3afeaa7351 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Acquiring lock "cinder-b9076656-2dfd-4e8e-8d7a-3768264b3716-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Lock "cinder-b9076656-2dfd-4e8e-8d7a-3768264b3716-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Acquiring lock "cinder-quobyte-b9076656-2dfd-4e8e-8d7a-3768264b3716" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Lock "cinder-quobyte-b9076656-2dfd-4e8e-8d7a-3768264b3716" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b775a5a9-d28d-49c5-9be6-f7065cdf95d8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:11 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 Apr 22 09:01:11 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-edc84fd9-84c0-40bf-8fef-711e11d34109 tempest-VolumesActionsTest-852218628 None] Acquiring lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-detach_volume" by "detach_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-edc84fd9-84c0-40bf-8fef-711e11d34109 tempest-VolumesActionsTest-852218628 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:11 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-edc84fd9-84c0-40bf-8fef-711e11d34109 tempest-VolumesActionsTest-852218628 None] Volume detach called, but volume not attached. Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-edc84fd9-84c0-40bf-8fef-711e11d34109 tempest-VolumesActionsTest-852218628 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:11 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716" returned: 0 in 0.473s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:11 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716 Apr 22 09:01:11 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:11 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b9076656-2dfd-4e8e-8d7a-3768264b3716" returned: 0 in 0.430s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Lock "cinder-quobyte-b9076656-2dfd-4e8e-8d7a-3768264b3716" released by "delete_volume" :: held 0.953s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:11 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Created reservations ['1fa4e767-689e-447a-9c7e-70228b6e7778', '2fbd03ef-abd0-44b0-8201-0f1df50d3ebd', '16455cd4-4225-4885-9faa-d0d89e5cf781', 'f564748b-866b-4efe-902e-80caed4c3fa1'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Acquiring lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Acquiring lock "cinder-quobyte-211faee7-32c3-47e4-96e7-cb845d583078" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:12 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:12 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Lock "cinder-quobyte-211faee7-32c3-47e4-96e7-cb845d583078" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e12f67-097a-48e2-ba16-b491d0241126]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:12 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 Apr 22 09:01:12 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:12 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.518s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Deleted volume successfully. Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4909de0a-c41a-4d16-afe4-b2a78b11b48d tempest-VolumesCloneNegativeTest-2035619202 None] Lock "cinder-b9076656-2dfd-4e8e-8d7a-3768264b3716-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:12 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078" returned: 0 in 0.539s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:12 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078 Apr 22 09:01:12 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:12 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:12 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:13 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-211faee7-32c3-47e4-96e7-cb845d583078" returned: 0 in 0.555s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Lock "cinder-quobyte-211faee7-32c3-47e4-96e7-cb845d583078" released by "delete_volume" :: held 1.136s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Created reservations ['b257d250-130b-4076-a87e-9fbf58a58332', '553dfabc-1b0e-418a-bf80-3c5d4b639322', '197525ea-f3ef-498f-9a59-9d3282e7a502', 'bf7ff465-c6bd-48ab-bb6c-40125ac7e8cf'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:13 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:13 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:13 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:13 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:13 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Deleted volume successfully. Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-125008e5-6321-496b-857e-12cdcd49947b tempest-VolumesActionsTest-852218628 None] Lock "cinder-211faee7-32c3-47e4-96e7-cb845d583078-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (05a9a294-b631-4b93-a10f-16820d7d363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc1e34d-de9a-4bf4-9bda-a6fce1d4f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc1e34d-de9a-4bf4-9bda-a6fce1d4f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2129698720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67960eb8-8739-44e4-949b-b2c7cf4f771c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:14Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265d27f8-c625-4954-8376-ac280c71b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265d27f8-c625-4954-8376-ac280c71b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26087c4-8974-402d-92b7-2da8145521fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26087c4-8974-402d-92b7-2da8145521fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67960eb8-8739-44e4-949b-b2c7cf4f771c', 'volume_name': 'volume-67960eb8-8739-44e4-949b-b2c7cf4f771c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa50978-066e-4e77-8cff-daae08676d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa50978-066e-4e77-8cff-daae08676d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceef1e3b-4623-459d-a718-4137236ffaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:14 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Volume 67960eb8-8739-44e4-949b-b2c7cf4f771c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67960eb8-8739-44e4-949b-b2c7cf4f771c', 'volume_size': 1} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2129698720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67960eb8-8739-44e4-949b-b2c7cf4f771c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:14Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Creating volume 67960eb8-8739-44e4-949b-b2c7cf4f771c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:14 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:14 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c 1073741824 Apr 22 09:01:14 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:14 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c 1073741824" returned: 0 in 0.589s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:14 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c Apr 22 09:01:14 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:15 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceef1e3b-4623-459d-a718-4137236ffaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67960eb8-8739-44e4-949b-b2c7cf4f771c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505fe423-df98-478b-acc3-e1d0da45e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:15 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Volume volume-67960eb8-8739-44e4-949b-b2c7cf4f771c (67960eb8-8739-44e4-949b-b2c7cf4f771c): created successfully Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505fe423-df98-478b-acc3-e1d0da45e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (05a9a294-b631-4b93-a10f-16820d7d363e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-726714f3-7e0d-4413-8be7-6e4f163352ae tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (eebc2ff5-24c3-4bbd-8b34-bfcb0ac9e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290ea9ba-1c80-4a96-918e-757004b76c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290ea9ba-1c80-4a96-918e-757004b76c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1504814395',display_name='tempest-VolumesGetTest-Volume-526186090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c831e1-a371-4aa2-8896-48185b7cf7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:16Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdf0037-dfd6-454f-abba-8f46c9b66fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdf0037-dfd6-454f-abba-8f46c9b66fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5538970f-52fe-4bb4-82a7-ea01e5708a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5538970f-52fe-4bb4-82a7-ea01e5708a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c831e1-a371-4aa2-8896-48185b7cf7c8', 'volume_name': 'volume-37c831e1-a371-4aa2-8896-48185b7cf7c8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03f2612-3ddb-4c37-b069-49e70bf9f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03f2612-3ddb-4c37-b069-49e70bf9f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3548ad6-4457-4495-aa13-3186b07f6001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:16 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Volume 37c831e1-a371-4aa2-8896-48185b7cf7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c831e1-a371-4aa2-8896-48185b7cf7c8', 'volume_size': 1} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1504814395',display_name='tempest-VolumesGetTest-Volume-526186090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c831e1-a371-4aa2-8896-48185b7cf7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:16Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Creating volume 37c831e1-a371-4aa2-8896-48185b7cf7c8 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:16 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:16 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 1073741824 Apr 22 09:01:16 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:17 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 1073741824" returned: 0 in 0.531s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:17 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 Apr 22 09:01:17 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:17 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8" returned: 0 in 0.413s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3548ad6-4457-4495-aa13-3186b07f6001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c831e1-a371-4aa2-8896-48185b7cf7c8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba15986-15d4-488e-aad9-9a56afcc7df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:17 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Volume volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 (37c831e1-a371-4aa2-8896-48185b7cf7c8): created successfully Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba15986-15d4-488e-aad9-9a56afcc7df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (eebc2ff5-24c3-4bbd-8b34-bfcb0ac9e021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:17 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a2fad15e-ce72-4acd-9dc1-5704abc6e392 tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-37c831e1-a371-4aa2-8896-48185b7cf7c8-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Lock "cinder-37c831e1-a371-4aa2-8896-48185b7cf7c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-37c831e1-a371-4aa2-8896-48185b7cf7c8" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-37c831e1-a371-4aa2-8896-48185b7cf7c8" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[095528c8-4a12-4b63-9c24-c1588034c10f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:18 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 Apr 22 09:01:18 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:19 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:19 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8 Apr 22 09:01:19 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:19 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-37c831e1-a371-4aa2-8896-48185b7cf7c8" returned: 0 in 0.399s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-37c831e1-a371-4aa2-8896-48185b7cf7c8" released by "delete_volume" :: held 0.884s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Created reservations ['b03012cf-3288-4338-a946-c9d6ffe0c905', 'b528473b-ee13-4fda-9cd7-4edd43e38e80', 'ff5095f6-641e-4a14-a5ac-8178aaeec9c9', 'ee5071b8-ca9a-4f97-a55c-c2ac62af9a35'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:19 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:19 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-67960eb8-8739-44e4-949b-b2c7cf4f771c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Lock "cinder-67960eb8-8739-44e4-949b-b2c7cf4f771c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-67960eb8-8739-44e4-949b-b2c7cf4f771c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-67960eb8-8739-44e4-949b-b2c7cf4f771c" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ee5d0-19a7-42e1-a70d-21bd8a3f8222]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:19 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c Apr 22 09:01:19 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:20 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.417s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:20 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d73b5c02-731e-4fd4-9e33-984c1e7ecc81 tempest-VolumesGetTest-165698408 None] Lock "cinder-37c831e1-a371-4aa2-8896-48185b7cf7c8-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:20 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c" returned: 0 in 0.468s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:20 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c Apr 22 09:01:20 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:20 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-67960eb8-8739-44e4-949b-b2c7cf4f771c" returned: 0 in 0.389s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-67960eb8-8739-44e4-949b-b2c7cf4f771c" released by "delete_volume" :: held 0.893s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Created reservations ['998b7d28-2a61-4da9-b265-1030e40be1d2', 'cba9915a-a5cf-4ff9-bb7d-bd284a423700', '745fa3db-76b0-4499-8288-2a3b0d59c911', '449a79c0-de59-4c36-a60c-d6358ac9613d'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:20 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:20 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (7dee9272-3982-4e81-b58c-5112e661799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109deb53-30e8-4324-9ded-0831bf101e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109deb53-30e8-4324-9ded-0831bf101e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-669101071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b73cf26-aa50-4268-99f4-7e69c5f9fb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:21Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a543174d-8688-4c32-b4b2-828eb0f23367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a543174d-8688-4c32-b4b2-828eb0f23367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d92de6-1319-4e7b-b7aa-469839a2511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d92de6-1319-4e7b-b7aa-469839a2511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'volume_name': 'volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3948f752-41fb-4af5-bf6c-7af0dc2f5ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3948f752-41fb-4af5-bf6c-7af0dc2f5ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ff4f92-4d16-40c4-be45-abcfd7db4595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Volume 1b73cf26-aa50-4268-99f4-7e69c5f9fb28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'volume_size': 1} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-669101071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b73cf26-aa50-4268-99f4-7e69c5f9fb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:21Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Creating volume 1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:21 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:21 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:21 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 1073741824 Apr 22 09:01:21 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e5d99e65-948d-4a16-8e28-d12d3b694612 tempest-VolumesGetTest-165698408 None] Lock "cinder-67960eb8-8739-44e4-949b-b2c7cf4f771c-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (c2ad74ae-ba34-4799-af90-011f0816db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd0a9a8-1c3b-4951-94ac-e5a1b840c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd0a9a8-1c3b-4951-94ac-e5a1b840c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-615393958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985931db-656c-43d4-983c-ce30c119949b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:22Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee29ced-8559-4316-80e3-03cc1e64ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee29ced-8559-4316-80e3-03cc1e64ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a11bc37-f18d-4a50-96fe-26dee44aa29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a11bc37-f18d-4a50-96fe-26dee44aa29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985931db-656c-43d4-983c-ce30c119949b', 'volume_name': 'volume-985931db-656c-43d4-983c-ce30c119949b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a84a747-03de-4ad5-b62e-2e2464eeeafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a84a747-03de-4ad5-b62e-2e2464eeeafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984844e2-1056-471f-8c68-743b1cf7a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:21 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Volume 985931db-656c-43d4-983c-ce30c119949b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985931db-656c-43d4-983c-ce30c119949b', 'volume_size': 1} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:21 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 1073741824" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:21 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:21 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:22 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.425s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-615393958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985931db-656c-43d4-983c-ce30c119949b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:22Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Creating volume 985931db-656c-43d4-983c-ce30c119949b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:22 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ff4f92-4d16-40c4-be45-abcfd7db4595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:22 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b 1073741824 Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd5b448-7cf0-419b-a9b1-3fa1dee9c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:22 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:22 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Volume volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 (1b73cf26-aa50-4268-99f4-7e69c5f9fb28): created successfully Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd5b448-7cf0-419b-a9b1-3fa1dee9c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (7dee9272-3982-4e81-b58c-5112e661799d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:22 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b6d9acb6-5540-4b5c-bf2d-faec5a4efc2f tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:22 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b 1073741824" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:22 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b Apr 22 09:01:22 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:23 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b" returned: 0 in 0.417s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984844e2-1056-471f-8c68-743b1cf7a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985931db-656c-43d4-983c-ce30c119949b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb9e5e3-fbe2-4248-ab6b-a957f3ba37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:23 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Volume volume-985931db-656c-43d4-983c-ce30c119949b (985931db-656c-43d4-983c-ce30c119949b): created successfully Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb9e5e3-fbe2-4248-ab6b-a957f3ba37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (c2ad74ae-ba34-4799-af90-011f0816db6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:23 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a5a9c0c4-9126-4707-abf8-8da6a972fdcd tempest-VolumesActionsTest-852218628 None] Created volume successfully. Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (ea7ea4fd-1b48-4c54-a319-9f0105276e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458a5b64-007a-48c2-8afd-0b6ca73eb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458a5b64-007a-48c2-8afd-0b6ca73eb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-206805765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8037b938-ccff-4468-b7eb-15d443184cd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1b73cf26-aa50-4268-99f4-7e69c5f9fb28,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:24Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c1d5fb-f7ed-4e85-a0e9-59144a5219b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c1d5fb-f7ed-4e85-a0e9-59144a5219b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c80c6e-f0fa-457b-b265-97b9192f0464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c80c6e-f0fa-457b-b265-97b9192f0464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8037b938-ccff-4468-b7eb-15d443184cd5', 'volume_name': 'volume-8037b938-ccff-4468-b7eb-15d443184cd5', 'volume_size': 1, 'source_volid': '1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b60f16-c35e-4e85-a9e5-26e595c1f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b60f16-c35e-4e85-a9e5-26e595c1f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7accc14a-42e6-4451-8521-a7f76541b5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:23 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Volume 8037b938-ccff-4468-b7eb-15d443184cd5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8037b938-ccff-4468-b7eb-15d443184cd5', 'volume_size': 1, 'source_volid': '1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'source_volstatus': 'available'} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:23 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Cloning volume 1b73cf26-aa50-4268-99f4-7e69c5f9fb28 to volume 8037b938-ccff-4468-b7eb-15d443184cd5 Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Creating offline snapshot 49968d75-9460-4c85-9349-06ff39478b86 of volume 1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f7ffb0-257a-428c-bbe5-a4891da3e576]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-985931db-656c-43d4-983c-ce30c119949b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:23 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:23 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-985931db-656c-43d4-983c-ce30c119949b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-quobyte-985931db-656c-43d4-983c-ce30c119949b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-985931db-656c-43d4-983c-ce30c119949b" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0d91a0-6f54-49c5-8cb6-73d3723f916a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:23 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b Apr 22 09:01:23 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:24 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:24 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 1G Apr 22 09:01:24 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:24 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:24 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b Apr 22 09:01:24 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:24 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 1G" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:24 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 Apr 22 09:01:24 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:24 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-985931db-656c-43d4-983c-ce30c119949b" returned: 0 in 0.398s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-985931db-656c-43d4-983c-ce30c119949b" released by "delete_volume" :: held 0.876s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Created reservations ['1813475a-1383-4555-9c6a-24e07f3ad730', '0e172417-39b3-449f-98c4-1cbc05e12e1e', '902903aa-5d58-42a4-81c4-4dc9af75be8f', '0a89326b-f88c-4673-a104-0e163c8f585a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:24 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:24 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:25 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86" returned: 0 in 0.475s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:25 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 is being set with open permissions: ugo+rw Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:25 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 Apr 22 09:01:25 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (1b1cc35d-8a5d-4e3c-9f1a-88e28c3ef4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27585495-a558-458c-9fad-ba8601946135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:25 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.424s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27585495-a558-458c-9fad-ba8601946135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1475065329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:25Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5e51ac-a70d-45ed-a431-7b72698b0f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5e51ac-a70d-45ed-a431-7b72698b0f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ee6143-e994-42de-8515-8fc6db224ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ee6143-e994-42de-8515-8fc6db224ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3', 'volume_name': 'volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a704caa2-896b-46b6-971f-3d7ad8d15795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a704caa2-896b-46b6-971f-3d7ad8d15795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9399abb1-26ee-413f-adc2-d781bb646f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:25 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Volume 8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3', 'volume_size': 1} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:25 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Deleted volume successfully. Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-412accda-7f30-4b69-bb05-1b63f3ca6da8 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-985931db-656c-43d4-983c-ce30c119949b-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:25 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86" returned: 0 in 0.408s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:25 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info Apr 22 09:01:25 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:25 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:25 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info is being set with open permissions: ugo+rw Apr 22 09:01:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:25 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info Apr 22 09:01:25 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:26 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.info" returned: 0 in 0.386s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-8037b938-ccff-4468-b7eb-15d443184cd5" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-8037b938-ccff-4468-b7eb-15d443184cd5" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] snapshot: 49968d75-9460-4c85-9349-06ff39478b86, volume: 8037b938-ccff-4468-b7eb-15d443184cd5, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aca6bf8-1035-4cd7-9274-f482cb794bda]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:26 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 Apr 22 09:01:26 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:26 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86" returned: 0 in 0.442s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa2dd18-5be5-49ac-ac8e-47132cda5e7a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:26 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:26 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:27 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:27 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:01:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:27 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 Apr 22 09:01:27 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:29 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5" returned: 0 in 1.844s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:29 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2e800f-70fe-4176-a2b0-e542322290d9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:29 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:29 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:29 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.561s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:29 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:01:29 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Converted 1024.00 MB image at 554.72 MB/s Apr 22 09:01:29 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 is being set with open permissions: ugo+rw Apr 22 09:01:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:29 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 Apr 22 09:01:29 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:30 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5" returned: 0 in 0.382s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-8037b938-ccff-4468-b7eb-15d443184cd5" released by "_copy_volume_from_snapshot" :: held 3.720s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-49968d75-9460-4c85-9349-06ff39478b86" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-49968d75-9460-4c85-9349-06ff39478b86" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Deleting offline snapshot 49968d75-9460-4c85-9349-06ff39478b86 of volume 1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] snapshot_file for this snap is: volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b654f-ad79-44c2-9234-70d7b1498e24]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:30 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 Apr 22 09:01:30 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:30 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e10631-5929-4998-b349-9f31ea260350]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:30 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:30 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:30 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.468s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:31 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 Apr 22 09:01:31 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:31 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86" returned: 0 in 0.429s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:31 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86 Apr 22 09:01:31 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:31 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28.49968d75-9460-4c85-9349-06ff39478b86" returned: 0 in 0.384s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-49968d75-9460-4c85-9349-06ff39478b86" released by "_delete_snapshot" :: held 1.762s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.182s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.615s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1475065329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:25Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Creating volume 8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:31 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7accc14a-42e6-4451-8521-a7f76541b5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8037b938-ccff-4468-b7eb-15d443184cd5', 'volume_size': 1, 'source_volid': '1b73cf26-aa50-4268-99f4-7e69c5f9fb28', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:31 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 1073741824 Apr 22 09:01:31 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e13ac0-e348-4366-8c6c-dd38daff6044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:31 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Volume volume-8037b938-ccff-4468-b7eb-15d443184cd5 (8037b938-ccff-4468-b7eb-15d443184cd5): created successfully Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e13ac0-e348-4366-8c6c-dd38daff6044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (ea7ea4fd-1b48-4c54-a319-9f0105276e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:31 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-79e5a8a4-d3bb-49d8-80b7-2c4099d5f67f tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:32 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 1073741824" returned: 0 in 0.495s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:32 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 Apr 22 09:01:32 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (56a354a5-1746-4644-9dfd-cc3eb18d94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ed4315-110d-440d-a411-3c9b10d5a271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ed4315-110d-440d-a411-3c9b10d5a271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860583284',display_name='tempest-VolumesGetTest-Volume-1617386351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb50e50-1b63-429a-a7c1-1da5653d998c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:32Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7caf1b9-0785-48e5-b356-c35ab8b3aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7caf1b9-0785-48e5-b356-c35ab8b3aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3850f7-9ce1-40ee-b084-46a1114def63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3850f7-9ce1-40ee-b084-46a1114def63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb50e50-1b63-429a-a7c1-1da5653d998c', 'volume_name': 'volume-3cb50e50-1b63-429a-a7c1-1da5653d998c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d1764b-15a1-4271-88ca-3af40b81b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d1764b-15a1-4271-88ca-3af40b81b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d80ff-7b02-42b3-9358-e53fe0f5df14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:32 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Volume 3cb50e50-1b63-429a-a7c1-1da5653d998c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb50e50-1b63-429a-a7c1-1da5653d998c', 'volume_size': 1} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:32 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3" returned: 0 in 0.416s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860583284',display_name='tempest-VolumesGetTest-Volume-1617386351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb50e50-1b63-429a-a7c1-1da5653d998c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:32Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Creating volume 3cb50e50-1b63-429a-a7c1-1da5653d998c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:32 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9399abb1-26ee-413f-adc2-d781bb646f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:32 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c 1073741824 Apr 22 09:01:32 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f497f-86af-478a-8204-e079cce41bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:32 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Volume volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 (8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3): created successfully Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f497f-86af-478a-8204-e079cce41bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (1b1cc35d-8a5d-4e3c-9f1a-88e28c3ef4e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7f222517-a939-44b0-9143-9c3bf5a3fa41 tempest-VolumesActionsTest-852218628 None] Created volume successfully. Apr 22 09:01:33 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c 1073741824" returned: 0 in 0.493s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:33 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c Apr 22 09:01:33 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:33 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d80ff-7b02-42b3-9358-e53fe0f5df14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb50e50-1b63-429a-a7c1-1da5653d998c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e64bff-2ca5-4c9a-8844-9f51e0afa3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Volume volume-3cb50e50-1b63-429a-a7c1-1da5653d998c (3cb50e50-1b63-429a-a7c1-1da5653d998c): created successfully Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e64bff-2ca5-4c9a-8844-9f51e0afa3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (56a354a5-1746-4644-9dfd-cc3eb18d94e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-75a5c7c0-d2d8-4dc7-92d9-98aa7adb3463 tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-quobyte-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fbcff3-f095-4785-a51e-87b0808aa16f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:33 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 Apr 22 09:01:33 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:34 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:34 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3 Apr 22 09:01:34 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-3cb50e50-1b63-429a-a7c1-1da5653d998c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Lock "cinder-3cb50e50-1b63-429a-a7c1-1da5653d998c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-3cb50e50-1b63-429a-a7c1-1da5653d998c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-3cb50e50-1b63-429a-a7c1-1da5653d998c" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:34 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3" returned: 0 in 0.473s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[74812256-b142-413f-8555-33c376114fd9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3" released by "delete_volume" :: held 0.951s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Created reservations ['e3d2e699-b8d4-4ed4-947e-33217f0f038f', '08361de6-b411-4ac3-a589-c60ff333ba03', 'ec42c9c5-03e6-4ae2-9e94-4c0103a09a68', '9780408b-45db-47bf-9acc-7f8b7691ac9d'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:34 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c Apr 22 09:01:34 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:34 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:34 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (360b20e5-00d4-4814-8238-3e307ec20b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6c910b-8a06-434d-9946-3dfd156dafe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6c910b-8a06-434d-9946-3dfd156dafe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-758171525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d71cbe4-9394-4d82-8e35-9e37a9e79726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:35Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aa5450-ddb9-4f25-b235-b12956567f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aa5450-ddb9-4f25-b235-b12956567f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77a80d1-c979-4d1c-840d-0007758b06b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77a80d1-c979-4d1c-840d-0007758b06b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d71cbe4-9394-4d82-8e35-9e37a9e79726', 'volume_name': 'volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb192c59-6eb6-48d3-9a18-9d6f433fece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb192c59-6eb6-48d3-9a18-9d6f433fece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bc7211-c8c2-435e-b634-818f8b96ede6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:35 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Volume 1d71cbe4-9394-4d82-8e35-9e37a9e79726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726', 'volume_size': 1} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-758171525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d71cbe4-9394-4d82-8e35-9e37a9e79726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:35Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Creating volume 1d71cbe4-9394-4d82-8e35-9e37a9e79726 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:35 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:35 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 1073741824 Apr 22 09:01:35 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:35 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c" returned: 0 in 0.540s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:35 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:35 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c Apr 22 09:01:35 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Deleted volume successfully. Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-63f2b432-d18c-4af2-b3d3-d1c436865291 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-8bdb6c9f-2c47-4d66-9bd1-cdd46b8011b3-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:35 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3cb50e50-1b63-429a-a7c1-1da5653d998c" returned: 0 in 0.420s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-3cb50e50-1b63-429a-a7c1-1da5653d998c" released by "delete_volume" :: held 0.985s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:35 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 1073741824" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Created reservations ['d694467d-d669-4c21-a693-b8200ddbc673', '1c8e764e-700d-4010-a570-38a4423b6033', '862911a8-415b-4e0d-819d-4b4f6a6de8b8', 'efdfcc57-8cfc-45b2-87ff-0eac8f2f7cb0'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:35 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 Apr 22 09:01:35 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:35 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:35 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:36 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bc7211-c8c2-435e-b634-818f8b96ede6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2419f1db-384e-4b59-bf5b-de1a28ce19f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:36 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Volume volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 (1d71cbe4-9394-4d82-8e35-9e37a9e79726): created successfully Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2419f1db-384e-4b59-bf5b-de1a28ce19f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (360b20e5-00d4-4814-8238-3e307ec20b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-35b28cca-2ee2-44ba-8f98-901bc2b314da tempest-VolumesActionsTest-852218628 None] Created volume successfully. Apr 22 09:01:36 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2afee8ee-02fe-4ef1-87ef-2110b25258ee tempest-VolumesGetTest-165698408 None] Lock "cinder-3cb50e50-1b63-429a-a7c1-1da5653d998c-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-8037b938-ccff-4468-b7eb-15d443184cd5-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Lock "cinder-8037b938-ccff-4468-b7eb-15d443184cd5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-8037b938-ccff-4468-b7eb-15d443184cd5" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-8037b938-ccff-4468-b7eb-15d443184cd5" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0ce1f1-8b85-42ab-9600-830d288d534a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:36 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 Apr 22 09:01:36 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-1d71cbe4-9394-4d82-8e35-9e37a9e79726-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-1d71cbe4-9394-4d82-8e35-9e37a9e79726-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:37 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-quobyte-1d71cbe4-9394-4d82-8e35-9e37a9e79726" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5" returned: 0 in 0.496s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-1d71cbe4-9394-4d82-8e35-9e37a9e79726" acquired by "delete_volume" :: waited 0.022s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:37 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5 Apr 22 09:01:37 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c9955-72ea-444e-8ca2-4290b903f9f0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:37 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 Apr 22 09:01:37 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:37 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8037b938-ccff-4468-b7eb-15d443184cd5" returned: 0 in 0.389s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-8037b938-ccff-4468-b7eb-15d443184cd5" released by "delete_volume" :: held 0.911s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Created reservations ['d34550e3-8552-49e4-a95d-f86b8ec75805', 'faff40a3-31d9-4e8a-9ab7-88bb9662321f', '9bff1b0b-2550-42ba-bd70-0a17fdccfcf7', '7c9e5bfe-99be-41ba-b729-e9fe85ed4b1e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:37 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:37 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:37 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:37 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726 Apr 22 09:01:37 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-1b73cf26-aa50-4268-99f4-7e69c5f9fb28-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Lock "cinder-1b73cf26-aa50-4268-99f4-7e69c5f9fb28-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2491e6f-3135-4c54-accb-2e82dfe927b0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:38 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:38 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:38 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:38 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0581f936-ae5b-4d9f-b6a9-73f8aeda54cf tempest-VolumesGetTest-165698408 None] Lock "cinder-8037b938-ccff-4468-b7eb-15d443184cd5-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1d71cbe4-9394-4d82-8e35-9e37a9e79726" returned: 0 in 0.409s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-1d71cbe4-9394-4d82-8e35-9e37a9e79726" released by "delete_volume" :: held 0.917s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Created reservations ['d03ce4e7-76e6-460f-93a5-e47c58f8c287', 'f45351ea-f7f0-4756-8393-d4370d52047f', 'c782eca5-046a-44d9-a78a-f0401d9b4707', '918e4e9c-927f-451e-99f0-629ad9223fe1'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:38 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:38 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:38 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.528s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:38 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28 Apr 22 09:01:38 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (44f3b3a0-734a-47db-9bc5-a9a58f20629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15fac34-3955-4754-a95b-b7909ee58c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15fac34-3955-4754-a95b-b7909ee58c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578501289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafd48e1-4877-4e59-8f41-a8b9673f02e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:39Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4458212e-eaa0-4b80-a9e6-7c38338372fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4458212e-eaa0-4b80-a9e6-7c38338372fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894a8594-31f0-4578-b316-ed233b52be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894a8594-31f0-4578-b316-ed233b52be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafd48e1-4877-4e59-8f41-a8b9673f02e9', 'volume_name': 'volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdbce11-47dc-416e-b875-b20297883ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdbce11-47dc-416e-b875-b20297883ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c19b6a5-ccf5-4665-95cd-93d7a247c482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:38 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Volume aafd48e1-4877-4e59-8f41-a8b9673f02e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9', 'volume_size': 1} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578501289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafd48e1-4877-4e59-8f41-a8b9673f02e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:39Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Creating volume aafd48e1-4877-4e59-8f41-a8b9673f02e9 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:38 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:38 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 1073741824 Apr 22 09:01:38 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:38 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.477s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Deleted volume successfully. Apr 22 09:01:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db17f0ac-fa80-491a-bafe-420185e22339 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-1d71cbe4-9394-4d82-8e35-9e37a9e79726-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:39 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" returned: 0 in 0.426s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-1b73cf26-aa50-4268-99f4-7e69c5f9fb28" released by "delete_volume" :: held 0.984s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Created reservations ['d6c8ca11-441d-4d05-9a43-fd7525f82a4d', '2faf1a00-faf4-4c22-b1ed-1dcc5af33818', '3ee473db-1344-40e6-b2f8-9d869528c162', '2e9f03d7-0dc0-4725-8b8f-ae3ca4022955'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:39 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:39 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:39 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 1073741824" returned: 0 in 0.503s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:39 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 Apr 22 09:01:39 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:39 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.399s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7e71a82-39c8-4f6f-af65-2c3b00c82833 tempest-VolumesGetTest-165698408 None] Lock "cinder-1b73cf26-aa50-4268-99f4-7e69c5f9fb28-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:39 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9" returned: 0 in 0.421s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c19b6a5-ccf5-4665-95cd-93d7a247c482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803eaa2c-3c0d-4f15-ae1d-ffad5eab758a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:39 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Volume volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 (aafd48e1-4877-4e59-8f41-a8b9673f02e9): created successfully Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803eaa2c-3c0d-4f15-ae1d-ffad5eab758a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:39 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (44f3b3a0-734a-47db-9bc5-a9a58f20629a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-975c198e-1de6-4554-a57d-4153883fe488 tempest-VolumesActionsTest-852218628 None] Created volume successfully. Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (550bdb93-d5de-4250-8249-64312b396a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190b5a05-6a79-426d-a6c6-c3738b36173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190b5a05-6a79-426d-a6c6-c3738b36173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1645095836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bbb47d-69ae-43dd-ab1b-79105f3f2759,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:41Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c146606a-03df-4c87-8410-51719e2cf818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c146606a-03df-4c87-8410-51719e2cf818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a138bb0b-e74f-4e84-a1fe-f1585f53f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.image.glance [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Creating Keystone auth plugin from conf {{(pid=83774) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a138bb0b-e74f-4e84-a1fe-f1585f53f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70bbb47d-69ae-43dd-ab1b-79105f3f2759', 'volume_name': 'volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1b6fa4-38e9-4f2b-bd7f-32d93bb7b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1b6fa4-38e9-4f2b-bd7f-32d93bb7b14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d3ee70-cc07-4c1d-96ef-7510ba11ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:40 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Volume 70bbb47d-69ae-43dd-ab1b-79105f3f2759: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 09:01:40 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Trying to clone 70bbb47d-69ae-43dd-ab1b-79105f3f2759 from image 403fb852-3ee8-4a92-abbf-1734c0db4994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]). {{(pid=83774) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 22 09:01:41 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Image download 20.69 MB at 20.69 MB/s Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b8614c-209b-4687-90f7-0a64b46ad6f7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-aafd48e1-4877-4e59-8f41-a8b9673f02e9-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-aafd48e1-4877-4e59-8f41-a8b9673f02e9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "cinder-quobyte-aafd48e1-4877-4e59-8f41-a8b9673f02e9" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-aafd48e1-4877-4e59-8f41-a8b9673f02e9" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd881fbc-bca7-4e65-af98-e932c1a7206e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:41 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD Apr 22 09:01:41 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:41 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 Apr 22 09:01:41 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:41 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 is fetched for user 0a5d4d9a74a14138a9af3bfddea753b6. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 22 09:01:41 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c75334-e2a2-44fd-a382-70128eb66c32]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:41 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9 Apr 22 09:01:41 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:41 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD Apr 22 09:01:41 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:41 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-aafd48e1-4877-4e59-8f41-a8b9673f02e9" returned: 0 in 0.400s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-quobyte-aafd48e1-4877-4e59-8f41-a8b9673f02e9" released by "delete_volume" :: held 0.893s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Created reservations ['2fa5a7c7-92ca-4d01-9c94-45491af1013c', '4ac66ded-cf7c-47b8-afb8-1b4ff75f3477', '590f08bf-2280-4607-82a4-d664a349c638', '6adebb9b-01e1-47d0-ad71-55d293f49b37'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:42 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1645095836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bbb47d-69ae-43dd-ab1b-79105f3f2759,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:41Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Creating volume 70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:42 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:42 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 1073741824 Apr 22 09:01:42 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:42 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:42 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (44dd37bb-e9f6-4be7-a74f-8b11be37f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ac1dca-5684-453e-b9aa-fedb54b9219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ac1dca-5684-453e-b9aa-fedb54b9219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1464934391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234c05e7-ad3f-4bbe-9fed-1ad29fd270b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:42Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b332d95f-ed93-4ae0-a92a-eec8bd74d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b332d95f-ed93-4ae0-a92a-eec8bd74d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4f01e7-3219-4e2a-ab00-b12969f0c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4f01e7-3219-4e2a-ab00-b12969f0c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234c05e7-ad3f-4bbe-9fed-1ad29fd270b3', 'volume_name': 'volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ded38b7-5dfb-485a-bf9f-4943050dc93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ded38b7-5dfb-485a-bf9f-4943050dc93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11b81a6-7212-4419-b6ad-1e5622734206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Volume 234c05e7-ad3f-4bbe-9fed-1ad29fd270b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3', 'volume_size': 1} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:42 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.428s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Deleted volume successfully. Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fa3a695e-7b42-4566-ad84-a475ce720628 tempest-VolumesActionsTest-1390294567 None] Lock "cinder-aafd48e1-4877-4e59-8f41-a8b9673f02e9-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:42 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 1073741824" returned: 0 in 0.522s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:42 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:42 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:43 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 0 in 0.396s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1464934391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234c05e7-ad3f-4bbe-9fed-1ad29fd270b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6010363b95474fae468835e712df48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:42Z,use_quota=True,user_id='be14f92e2de946108080b95d7c5c1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Creating volume 234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:43 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:43 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 1073741824 Apr 22 09:01:43 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Attempting download of 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume 70bbb47d-69ae-43dd-ab1b-79105f3f2759. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[481916a4-4735-4ec8-ae42-77f71cfa8b0c]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:43 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn Apr 22 09:01:43 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:43 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 1073741824" returned: 0 in 0.487s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:43 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn" returned: 0 in 0.446s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:43 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 Apr 22 09:01:43 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:43 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn Apr 22 09:01:43 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:43 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11b81a6-7212-4419-b6ad-1e5622734206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5731c91d-0865-4636-b5b3-7e00fd41324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Volume volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 (234c05e7-ad3f-4bbe-9fed-1ad29fd270b3): created successfully Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5731c91d-0865-4636-b5b3-7e00fd41324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Flow 'volume_create_manager' (44dd37bb-e9f6-4be7-a74f-8b11be37f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:43 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn" returned: 1 in 0.458s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_403fb852-3ee8-4a92-abbf-1734c0db4994_ue0jjogn' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5572c69-a1bb-47b8-875d-0b02907fd5c2]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:44 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8425417e-7fb4-4d7e-90de-732c4a3da3d5 tempest-VolumesActionsTest-852218628 None] Created volume successfully. Apr 22 09:01:44 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD Apr 22 09:01:44 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:44 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:44 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] 403fb852-3ee8-4a92-abbf-1734c0db4994 was qcow2, converting to raw {{(pid=83774) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 22 09:01:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:44 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:44 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Acquiring lock "cinder-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Lock "cinder-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Acquiring lock "cinder-quobyte-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Lock "cinder-quobyte-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5079c0-d563-4953-8ab0-1291b7459e5c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:45 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 Apr 22 09:01:45 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:45 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 0 in 0.875s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_403fb852-3ee8-4a92-abbf-1734c0db4994_mljpj61ydevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:01:45 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Converted 112.00 MB image at 112.00 MB/s Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:45 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 1G Apr 22 09:01:45 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:45 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3" returned: 0 in 0.465s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:45 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3 Apr 22 09:01:45 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:45 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 1G" returned: 0 in 0.412s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec0423a-ab50-4142-9305-8ba88419a468]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:45 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:45 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:45 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Lock "cinder-quobyte-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3" released by "delete_volume" :: held 0.885s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:45 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Created reservations ['8fd309c1-472d-4ca0-9e98-0e2f9db97e77', 'e4bb544e-2d30-4f97-a5ed-0bce0634bfab', '65c7ab8e-2d86-4859-bc43-d08b5615a5ec', 'd3be8b6d-ad01-40ee-8459-4c75bdf6bcde'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:46 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:46 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:46 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:46 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:46 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:46 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.436s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Deleted volume successfully. Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-22caa89d-4fb7-4560-8d30-6e952e8f3acb tempest-VolumesActionsTest-852218628 None] Lock "cinder-234c05e7-ad3f-4bbe-9fed-1ad29fd270b3-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:46 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 1 in 0.492s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Downloaded image 403fb852-3ee8-4a92-abbf-1734c0db4994 ((None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}])) to volume 70bbb47d-69ae-43dd-ab1b-79105f3f2759 successfully. {{(pid=83774) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Temporary image 403fb852-3ee8-4a92-abbf-1734c0db4994 for user 0a5d4d9a74a14138a9af3bfddea753b6 is deleted. {{(pid=83774) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.volume_utils [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Marking volume 70bbb47d-69ae-43dd-ab1b-79105f3f2759 as bootable. {{(pid=83774) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Copying metadata from image 403fb852-3ee8-4a92-abbf-1734c0db4994 to 70bbb47d-69ae-43dd-ab1b-79105f3f2759. {{(pid=83774) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Creating volume glance metadata for volume 70bbb47d-69ae-43dd-ab1b-79105f3f2759 backed by image 403fb852-3ee8-4a92-abbf-1734c0db4994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83774) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d3ee70-cc07-4c1d-96ef-7510ba11ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759', 'volume_size': 1, 'image_id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/403fb852-3ee8-4a92-abbf-1734c0db4994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a18c5fc667847c98740664e4dfb63a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '403fb852-3ee8-4a92-abbf-1734c0db4994', 'created_at': datetime.datetime(2026, 4, 22, 6, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 6, 50, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/403fb852-3ee8-4a92-abbf-1734c0db4994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafbabc3-5dc5-4979-b767-c4a76331e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:46 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Volume volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 (70bbb47d-69ae-43dd-ab1b-79105f3f2759): created successfully Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafbabc3-5dc5-4979-b767-c4a76331e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (550bdb93-d5de-4250-8249-64312b396a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-40ec8417-873f-4fdd-a520-ef3c9b49eb86 tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (7f4e0592-39d2-4898-848a-336dbca07042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d6eb4d-93f5-4db0-b069-6f20f5867b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d6eb4d-93f5-4db0-b069-6f20f5867b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1087903517',display_name='tempest-VolumesGetTest-Volume-711393510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51136161-8a0b-4a42-8c2b-7bc1d21e0a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:48Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c124a784-0e6f-42c7-b577-caaa7c689580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c124a784-0e6f-42c7-b577-caaa7c689580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8695b5a-5382-416c-a32b-9c83fe97ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8695b5a-5382-416c-a32b-9c83fe97ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51136161-8a0b-4a42-8c2b-7bc1d21e0a6b', 'volume_name': 'volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e75e6a6-ddf0-472b-b43b-54873c53d330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e75e6a6-ddf0-472b-b43b-54873c53d330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9253e-30be-4d09-975c-7212f5cc50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:48 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Volume 51136161-8a0b-4a42-8c2b-7bc1d21e0a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b', 'volume_size': 1} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1087903517',display_name='tempest-VolumesGetTest-Volume-711393510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51136161-8a0b-4a42-8c2b-7bc1d21e0a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cae892fb5c4818b64dabade03d390e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:48Z,use_quota=True,user_id='0a5d4d9a74a14138a9af3bfddea753b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Creating volume 51136161-8a0b-4a42-8c2b-7bc1d21e0a6b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:48 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:48 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b 1073741824 Apr 22 09:01:48 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:48 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b 1073741824" returned: 0 in 0.539s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:49 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b Apr 22 09:01:49 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:49 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b" returned: 0 in 0.425s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9253e-30be-4d09-975c-7212f5cc50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7420c6-2d0e-4d4f-b9e1-2c8888e30427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Volume volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b (51136161-8a0b-4a42-8c2b-7bc1d21e0a6b): created successfully Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7420c6-2d0e-4d4f-b9e1-2c8888e30427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Flow 'volume_create_manager' (7f4e0592-39d2-4898-848a-336dbca07042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:49 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4d482b06-5ecc-467a-aafe-398e61899c38 tempest-VolumesGetTest-165698408 None] Created volume successfully. Apr 22 09:01:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Lock "cinder-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:50 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b9c7c6-e1f1-4bd6-9228-1c70c1a8679d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:50 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b Apr 22 09:01:50 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:51 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b" returned: 0 in 0.542s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:51 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b Apr 22 09:01:51 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:51 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b" released by "delete_volume" :: held 1.016s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Created reservations ['28ebc883-db69-40de-9156-75cb32909621', 'aae64105-3da8-4307-8319-28a34f70b587', 'a28b2e4a-9e00-4176-8a64-a6989896b5eb', 'd2e0c8fd-be4f-4e96-9c50-4ee327b16e65'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:51 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:51 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:52 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:52 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8ce0d7b7-a120-4034-af84-99de7352337d tempest-VolumesGetTest-165698408 None] Lock "cinder-51136161-8a0b-4a42-8c2b-7bc1d21e0a6b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-70bbb47d-69ae-43dd-ab1b-79105f3f2759-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Lock "cinder-70bbb47d-69ae-43dd-ab1b-79105f3f2759-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Acquiring lock "cinder-quobyte-70bbb47d-69ae-43dd-ab1b-79105f3f2759" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Flow 'volume_create_manager' (abdb1b29-0bb6-4cd6-89d8-71740b315a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ae072c-a1f6-4202-ae48-524392ec4e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-70bbb47d-69ae-43dd-ab1b-79105f3f2759" acquired by "delete_volume" :: waited 0.035s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ae072c-a1f6-4202-ae48-524392ec4e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1370822859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a165a8ef-e64d-42e2-a23f-b4d86fd59a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a060d87786e2404abb2066b16e60ad4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:53Z,use_quota=True,user_id='97dfb0bb492d47789333301e0f67877d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce93ad8-92ee-4eb6-92f2-d276d1a5df60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce93ad8-92ee-4eb6-92f2-d276d1a5df60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdabd05-6b0e-4994-8379-38cffe1cef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdabd05-6b0e-4994-8379-38cffe1cef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a165a8ef-e64d-42e2-a23f-b4d86fd59a45', 'volume_name': 'volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a191007d-407a-4d94-ad2e-1e36d20e4258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a191007d-407a-4d94-ad2e-1e36d20e4258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784da06a-5781-4d8d-b86b-db798d692f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:53 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Volume a165a8ef-e64d-42e2-a23f-b4d86fd59a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45', 'volume_size': 1} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1370822859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a165a8ef-e64d-42e2-a23f-b4d86fd59a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a060d87786e2404abb2066b16e60ad4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:53Z,use_quota=True,user_id='97dfb0bb492d47789333301e0f67877d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Creating volume a165a8ef-e64d-42e2-a23f-b4d86fd59a45 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:53 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc8e915-09c1-49ba-8ca1-dcb550d00c9a]: (4, 'raw') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:53 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 1073741824 Apr 22 09:01:53 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:53 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:53 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:53 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 1073741824" returned: 0 in 0.456s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:53 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:53 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:53 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:53 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:53 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:53 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784da06a-5781-4d8d-b86b-db798d692f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e91d89c-9273-4694-a685-339fab8dc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:53 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Volume volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 (a165a8ef-e64d-42e2-a23f-b4d86fd59a45): created successfully Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e91d89c-9273-4694-a685-339fab8dc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Flow 'volume_create_manager' (abdb1b29-0bb6-4cd6-89d8-71740b315a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0998c283-5125-4cb3-b09d-dc1494aee8ce tempest-VolumesMetadataTest-243989347 None] Created volume successfully. Apr 22 09:01:53 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 1 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759' failed. Not Retrying. {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:01:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:54 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759 Apr 22 09:01:54 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:54 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70bbb47d-69ae-43dd-ab1b-79105f3f2759" returned: 0 in 0.381s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Lock "cinder-quobyte-70bbb47d-69ae-43dd-ab1b-79105f3f2759" released by "delete_volume" :: held 1.406s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Created reservations ['1a1fbce1-75a9-48b6-9ed6-9b572829a803', 'def81d38-5f3a-4baf-8bd4-8d42a6452041', 'b7c59691-a464-4b7f-9c4b-0937505def60', '4020a29e-f02a-4ae3-b417-6757cedfd654'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:54 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:54 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:54 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Deleted volume successfully. Apr 22 09:01:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ee04d81e-fc9f-4742-a507-205f6409fd26 tempest-VolumesGetTest-165698408 None] Lock "cinder-70bbb47d-69ae-43dd-ab1b-79105f3f2759-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Acquiring lock "cinder-a165a8ef-e64d-42e2-a23f-b4d86fd59a45-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Lock "cinder-a165a8ef-e64d-42e2-a23f-b4d86fd59a45-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Acquiring lock "cinder-quobyte-a165a8ef-e64d-42e2-a23f-b4d86fd59a45" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:01:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Lock "cinder-quobyte-a165a8ef-e64d-42e2-a23f-b4d86fd59a45" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:01:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[56734acf-5f15-4bd0-89b7-fe962d5ffe4f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:55 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 Apr 22 09:01:55 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:56 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45" returned: 0 in 0.575s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:56 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45 Apr 22 09:01:56 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:56 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a165a8ef-e64d-42e2-a23f-b4d86fd59a45" returned: 0 in 0.488s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Lock "cinder-quobyte-a165a8ef-e64d-42e2-a23f-b4d86fd59a45" released by "delete_volume" :: held 1.084s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Created reservations ['014eea00-b716-4202-a4e6-d64791b7976c', '7f4d9310-39a4-4e7c-b2c5-0c12aeb35e45', 'c853263e-a1b7-455e-8897-2aa14605e062', '7d0848fd-ee78-41f0-b610-262cef8e3716'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:56 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:01:56 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Flow 'volume_create_manager' (ab6036a3-96de-4fff-b1ba-69f751855c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5b43e0-9bab-470d-bcf7-770788953e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5b43e0-9bab-470d-bcf7-770788953e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-492116892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70022112-f63a-4daa-88aa-280fc893b3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79672671a5c46f88007b14024a7ddab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:57Z,use_quota=True,user_id='e99d32b797124d19b9ed8b3657cfc48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b13caa7-3721-4ab0-8f60-78cef00c0f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b13caa7-3721-4ab0-8f60-78cef00c0f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27acc9ef-a1ea-4ee8-b9a9-0d1d89f0a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27acc9ef-a1ea-4ee8-b9a9-0d1d89f0a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70022112-f63a-4daa-88aa-280fc893b3ce', 'volume_name': 'volume-70022112-f63a-4daa-88aa-280fc893b3ce', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3b6c1a-0979-42cb-8cf9-b71c89477a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3b6c1a-0979-42cb-8cf9-b71c89477a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a53a6ae-0632-494b-87f5-141a070c7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:56 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Volume 70022112-f63a-4daa-88aa-280fc893b3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70022112-f63a-4daa-88aa-280fc893b3ce', 'volume_size': 1} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-492116892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70022112-f63a-4daa-88aa-280fc893b3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79672671a5c46f88007b14024a7ddab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:01:57Z,use_quota=True,user_id='e99d32b797124d19b9ed8b3657cfc48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Creating volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:01:56 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:01:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:56 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce 1073741824 Apr 22 09:01:56 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:57 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.411s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:01:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Deleted volume successfully. Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b6757951-bb95-4c1c-9c53-491ab64660a4 tempest-VolumesMetadataTest-243989347 None] Lock "cinder-a165a8ef-e64d-42e2-a23f-b4d86fd59a45-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:01:57 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce 1073741824" returned: 0 in 0.481s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:57 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce Apr 22 09:01:57 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:57 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce" returned: 0 in 0.411s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a53a6ae-0632-494b-87f5-141a070c7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70022112-f63a-4daa-88aa-280fc893b3ce', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf07aa9-8635-4578-a7cb-cd1ad6723e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:01:57 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Volume volume-70022112-f63a-4daa-88aa-280fc893b3ce (70022112-f63a-4daa-88aa-280fc893b3ce): created successfully Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf07aa9-8635-4578-a7cb-cd1ad6723e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:01:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Flow 'volume_create_manager' (ab6036a3-96de-4fff-b1ba-69f751855c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:01:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-bbec7a2a-8e77-4e27-a009-ba2e2c433ce8 tempest-VolumesSnapshotListTestJSON-982165386 None] Created volume successfully. Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Creating offline snapshot 99d3599a-0efc-403e-9359-a1bbd854d929 of volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[99364768-f4ea-40a3-8d3b-516f35302efa]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:59 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce Apr 22 09:01:59 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:01:59 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce" returned: 0 in 0.508s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:01:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:01:59 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 1G Apr 22 09:01:59 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:00 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 1G" returned: 0 in 0.516s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:00 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:00 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Flow 'volume_create_manager' (88088316-b36e-4952-8720-3379bcab3f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eefb0c6-2ea4-48cc-ab5e-e37ad26e58aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eefb0c6-2ea4-48cc-ab5e-e37ad26e58aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-611706145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92834ac4-2e3a-4378-b2c1-5529cb9280ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8c338c9dd482789cbdf2e5cdc1371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:00Z,use_quota=True,user_id='5ffe35e617c84b9babab1f8f5a53b0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8982cd-9e39-452f-b37e-18a9d0f332d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8982cd-9e39-452f-b37e-18a9d0f332d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e268815a-409a-47a0-b633-8ebca9faf965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e268815a-409a-47a0-b633-8ebca9faf965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92834ac4-2e3a-4378-b2c1-5529cb9280ef', 'volume_name': 'volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba85f59-3abc-4f0f-bd42-60aedd6d39d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba85f59-3abc-4f0f-bd42-60aedd6d39d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c13288-8f16-4c32-bafa-ae3f7133f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:00 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Volume 92834ac4-2e3a-4378-b2c1-5529cb9280ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef', 'volume_size': 1} Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:00 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:00 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 is being set with open permissions: ugo+rw Apr 22 09:02:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:00 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:00 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:01 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.439s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:01 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info Apr 22 09:02:01 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:01 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info" returned: 0 in 0.404s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:01 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info is being set with open permissions: ugo+rw Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:01 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info Apr 22 09:02:01 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:01 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.info" returned: 0 in 0.413s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.806s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-611706145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92834ac4-2e3a-4378-b2c1-5529cb9280ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8c338c9dd482789cbdf2e5cdc1371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:00Z,use_quota=True,user_id='5ffe35e617c84b9babab1f8f5a53b0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Creating volume 92834ac4-2e3a-4378-b2c1-5529cb9280ef {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:02:01 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:02:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:01 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef 1073741824 Apr 22 09:02:01 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:01 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5b37318a-2688-450f-a578-8cf0c612426c tempest-VolumesSnapshotListTestJSON-982165386 None] Create snapshot completed successfully Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:02 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef 1073741824" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:02 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef Apr 22 09:02:02 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:02 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef" returned: 0 in 0.400s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.509s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Creating offline snapshot 6acc656c-1049-4b3e-90f5-fe2a4a2619e3 of volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c13288-8f16-4c32-bafa-ae3f7133f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77843261-23dd-4457-a145-6d59ecdd6900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f5a68-6a3c-49a1-808e-3972416ccbb3]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:02 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Volume volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef (92834ac4-2e3a-4378-b2c1-5529cb9280ef): created successfully Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77843261-23dd-4457-a145-6d59ecdd6900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Flow 'volume_create_manager' (88088316-b36e-4952-8720-3379bcab3f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:02 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6ac60120-ca2c-479c-bcf8-b631ddb2afd2 tempest-VolumesTransfersV357Test-1081477914 None] Created volume successfully. Apr 22 09:02:02 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:02 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:03 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:03 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 1G Apr 22 09:02:03 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:03 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 1G" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:03 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:03 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-822e9057-6d42-467c-93b1-99c04e9f8293 tempest-VolumesTransfersV357Test-1249338235 None] Transfer volume completed successfully. Apr 22 09:02:04 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.430s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:04 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 is being set with open permissions: ugo+rw Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:04 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:04 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:04 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.423s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:04 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-87267a13-b9c2-47a9-a5eb-838058c63929 tempest-VolumesSnapshotListTestJSON-982165386 None] Create snapshot completed successfully Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Acquiring lock "cinder-92834ac4-2e3a-4378-b2c1-5529cb9280ef-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-92834ac4-2e3a-4378-b2c1-5529cb9280ef-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Acquiring lock "cinder-quobyte-92834ac4-2e3a-4378-b2c1-5529cb9280ef" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-quobyte-92834ac4-2e3a-4378-b2c1-5529cb9280ef" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9a0fa-5a14-4812-8119-e907b3f4ae4c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:04 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef Apr 22 09:02:04 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:05 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef" returned: 0 in 0.446s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:05 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef Apr 22 09:02:05 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Creating offline snapshot cb860d28-86ad-4b82-84d1-e78ca1fb6e70 of volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e186c4-0564-4272-bc7d-4f9774cf5493]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:05 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:05 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:05 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-92834ac4-2e3a-4378-b2c1-5529cb9280ef" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-quobyte-92834ac4-2e3a-4378-b2c1-5529cb9280ef" released by "delete_volume" :: held 0.888s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Created reservations ['7b7528f2-69d3-440b-9c90-a22058a532aa', '8a140586-e5d2-46e0-9208-750e468890d6', '1931a4d3-0f5e-4c2b-8507-1c476f6c80ce', '1dd5ea19-be82-4667-b32d-1097d66800ac'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:05 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:02:05 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:06 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.512s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:06 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 1G Apr 22 09:02:06 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:06 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:02:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Deleted volume successfully. Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=207,cinder:SELECT=142,cinder:INSERT=43,cinder:DELETE=16 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0153ed8a-3802-46c9-a6e0-ff0dc3cd0da6 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-92834ac4-2e3a-4378-b2c1-5529cb9280ef-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=139,cinder:UPDATE=171,cinder:INSERT=56,cinder:DELETE=19 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Flow 'volume_create_manager' (0e926e8c-6f13-4244-b843-355378840265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db49ee3-eac6-46ee-bfd0-73e438f642a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db49ee3-eac6-46ee-bfd0-73e438f642a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1339112676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5ccdf-9ddb-4695-9788-295ce23a19e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8c338c9dd482789cbdf2e5cdc1371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:06Z,use_quota=True,user_id='5ffe35e617c84b9babab1f8f5a53b0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3666d27-deb5-4ced-a08e-e1b227ca32ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3666d27-deb5-4ced-a08e-e1b227ca32ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c35b5b-d921-40d0-bae0-bcdda683df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c35b5b-d921-40d0-bae0-bcdda683df1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d5ccdf-9ddb-4695-9788-295ce23a19e6', 'volume_name': 'volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2e6514-8caa-4eb6-84a4-bd223598ac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2e6514-8caa-4eb6-84a4-bd223598ac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbb4a10-086f-4ff6-9733-e716d87d5ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:06 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Volume 76d5ccdf-9ddb-4695-9788-295ce23a19e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6', 'volume_size': 1} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:06 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 1G" returned: 0 in 0.562s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:06 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 Apr 22 09:02:06 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:06 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70" returned: 0 in 0.408s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:07 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 is being set with open permissions: ugo+rw Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:07 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 Apr 22 09:02:07 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:07 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70" returned: 0 in 0.409s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1339112676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5ccdf-9ddb-4695-9788-295ce23a19e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8c338c9dd482789cbdf2e5cdc1371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:06Z,use_quota=True,user_id='5ffe35e617c84b9babab1f8f5a53b0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Creating volume 76d5ccdf-9ddb-4695-9788-295ce23a19e6 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:02:07 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:07 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 1073741824 Apr 22 09:02:07 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-eef80718-cad9-445e-be1c-21f2e6460d93 tempest-VolumesSnapshotListTestJSON-982165386 None] Create snapshot completed successfully Apr 22 09:02:07 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:07 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 1073741824" returned: 0 in 0.551s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:08 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 Apr 22 09:02:08 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-cb860d28-86ad-4b82-84d1-e78ca1fb6e70-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-cb860d28-86ad-4b82-84d1-e78ca1fb6e70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-cb860d28-86ad-4b82-84d1-e78ca1fb6e70" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-cb860d28-86ad-4b82-84d1-e78ca1fb6e70" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Deleting offline snapshot cb860d28-86ad-4b82-84d1-e78ca1fb6e70 of volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] snapshot_file for this snap is: volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fff18f-460a-4a2d-b163-6929c6f13bb1]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:08 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6" returned: 0 in 0.426s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbb4a10-086f-4ff6-9733-e716d87d5ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030fd3af-ab4e-4b8f-b049-06a0bde43e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:08 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Volume volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 (76d5ccdf-9ddb-4695-9788-295ce23a19e6): created successfully Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030fd3af-ab4e-4b8f-b049-06a0bde43e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Flow 'volume_create_manager' (0e926e8c-6f13-4244-b843-355378840265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d2282b38-8fb6-4e6b-9a34-6b5aea2c33fb tempest-VolumesTransfersV357Test-1081477914 None] Created volume successfully. Apr 22 09:02:08 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 Apr 22 09:02:08 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:08 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe653c5-7d7c-42c8-9143-018c9c61e61e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:08 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:08 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:09 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.475s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:09 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 Apr 22 09:02:09 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Acquiring lock "cinder-76d5ccdf-9ddb-4695-9788-295ce23a19e6-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-76d5ccdf-9ddb-4695-9788-295ce23a19e6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Acquiring lock "cinder-quobyte-76d5ccdf-9ddb-4695-9788-295ce23a19e6" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-quobyte-76d5ccdf-9ddb-4695-9788-295ce23a19e6" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b4916-2d2a-46c3-beba-2e4a8a394937]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:09 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 Apr 22 09:02:09 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:09 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:09 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70 Apr 22 09:02:09 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:10 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:10 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6 Apr 22 09:02:10 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:10 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.cb860d28-86ad-4b82-84d1-e78ca1fb6e70" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-cb860d28-86ad-4b82-84d1-e78ca1fb6e70" released by "_delete_snapshot" :: held 1.871s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" released by "delete_snapshot" :: held 1.883s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Created reservations ['668709b7-31e5-4be4-9b74-3983a231b448', 'f99bf327-6004-46f0-a162-e19a9f21a5c1', '85ccb736-e1fa-46b4-98db-0132f6857df4', '958c72c7-15c7-48e5-83f3-b26c428e0040'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Delete snapshot completed successfully. Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5dfa9aa5-3e74-4c54-8956-35ee1c351fc9 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-cb860d28-86ad-4b82-84d1-e78ca1fb6e70-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:10 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-76d5ccdf-9ddb-4695-9788-295ce23a19e6" returned: 0 in 0.410s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-quobyte-76d5ccdf-9ddb-4695-9788-295ce23a19e6" released by "delete_volume" :: held 0.893s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-6acc656c-1049-4b3e-90f5-fe2a4a2619e3-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Created reservations ['f671dab9-ccda-4801-afe2-26f5e2ceba02', '2be3068c-4b33-4d39-8550-1fccd9a82bb4', 'e58cb45d-ab6d-4520-bc62-1cab412378b8', 'c5f671c6-9e09-4900-b6ed-7d1fbaa75ea5'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-6acc656c-1049-4b3e-90f5-fe2a4a2619e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-6acc656c-1049-4b3e-90f5-fe2a4a2619e3" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-6acc656c-1049-4b3e-90f5-fe2a4a2619e3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Deleting offline snapshot 6acc656c-1049-4b3e-90f5-fe2a4a2619e3 of volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] snapshot_file for this snap is: volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2259b89-a5dc-4342-85e8-d950ce050a80]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:10 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:02:10 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:10 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:10 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:11 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.443s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:02:11 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Deleted volume successfully. Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-32f271ff-d0b8-4a68-9c43-476cfbf39cd3 tempest-VolumesTransfersV357Test-358637124 None] Lock "cinder-76d5ccdf-9ddb-4695-9788-295ce23a19e6-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:11 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.528s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e3130-1dc3-458f-b351-c235e6aa578c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:11 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:11 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:11 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.540s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:11 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:11 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:12 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:12 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3 Apr 22 09:02:12 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:12 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.6acc656c-1049-4b3e-90f5-fe2a4a2619e3" returned: 0 in 0.495s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-6acc656c-1049-4b3e-90f5-fe2a4a2619e3" released by "_delete_snapshot" :: held 2.100s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" released by "delete_snapshot" :: held 2.127s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Created reservations ['0644cdb7-82a1-4aff-8bfe-3a599b0d5ab7', '82e4880e-3a80-4550-bd3e-eb513b7ef0ef', 'f2bcc621-6c4b-4631-96a8-95a24ec1ca9b', 'c4f77639-fc1e-4916-bb74-c4787d7709f7'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Delete snapshot completed successfully. Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-c858f44a-847e-4f27-8f86-63ee4f710f46 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-6acc656c-1049-4b3e-90f5-fe2a4a2619e3-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:12 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:02:12 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:13 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.453s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-99d3599a-0efc-403e-9359-a1bbd854d929-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-99d3599a-0efc-403e-9359-a1bbd854d929-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-99d3599a-0efc-403e-9359-a1bbd854d929" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-99d3599a-0efc-403e-9359-a1bbd854d929" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Deleting offline snapshot 99d3599a-0efc-403e-9359-a1bbd854d929 of volume 70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] snapshot_file for this snap is: volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabaec89-8c44-498a-85c0-9a1030a28fed]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:13 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:13 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Flow 'volume_create_manager' (6aab3f5f-fe41-4828-b2f3-64845ffb1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9581031d-d2c9-4d8e-85ea-18bc0fbff9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9581031d-d2c9-4d8e-85ea-18bc0fbff9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1332967175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08d02eb-a926-49f5-aafc-1afb2c1402c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751eb4f26a0d46d196f52f8595d4f91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:14Z,use_quota=True,user_id='14fdb47dc5144c16ac9108a5a66727c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d4bfb5-e881-407f-8454-a46bf342204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d4bfb5-e881-407f-8454-a46bf342204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbcb7b2-e825-4fcb-98f4-ccc3b6cb840f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbcb7b2-e825-4fcb-98f4-ccc3b6cb840f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08d02eb-a926-49f5-aafc-1afb2c1402c3', 'volume_name': 'volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40c159d-e5bd-4f71-8cd9-c1aa3e0f9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40c159d-e5bd-4f71-8cd9-c1aa3e0f9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf14c866-8c0a-4e39-b2f2-7ca7080714bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:13 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Volume b08d02eb-a926-49f5-aafc-1afb2c1402c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3', 'volume_size': 1} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1332967175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08d02eb-a926-49f5-aafc-1afb2c1402c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751eb4f26a0d46d196f52f8595d4f91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:14Z,use_quota=True,user_id='14fdb47dc5144c16ac9108a5a66727c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Creating volume b08d02eb-a926-49f5-aafc-1afb2c1402c3 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:02:13 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:02:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:13 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 1073741824 Apr 22 09:02:13 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:14 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70022112-f63a-4daa-88aa-280fc893b3ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f014e1-d878-40d8-baf2-8f5093a3ad74]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:14 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce Apr 22 09:02:14 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:14 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 1073741824" returned: 0 in 0.478s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:14 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 Apr 22 09:02:14 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:14 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce" returned: 0 in 0.469s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:14 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:14 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:14 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3" returned: 0 in 0.398s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf14c866-8c0a-4e39-b2f2-7ca7080714bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5c009b-7493-4106-baa2-4170b4231517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:14 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Volume volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 (b08d02eb-a926-49f5-aafc-1afb2c1402c3): created successfully Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5c009b-7493-4106-baa2-4170b4231517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:14 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Flow 'volume_create_manager' (6aab3f5f-fe41-4828-b2f3-64845ffb1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:14 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0cd535ae-73ca-4e75-a9d9-27775964b29a tempest-VolumesNegativeTest-1608723246 None] Created volume successfully. Apr 22 09:02:15 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.451s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:15 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929 Apr 22 09:02:15 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:15 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce.99d3599a-0efc-403e-9359-a1bbd854d929" returned: 0 in 0.388s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-99d3599a-0efc-403e-9359-a1bbd854d929" released by "_delete_snapshot" :: held 1.827s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" released by "delete_snapshot" :: held 1.841s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Created reservations ['6cfad7c0-0683-466d-8af0-c9833fca4037', 'fff55750-e919-433d-b3bc-cef88f5100be', '609bff95-0b0c-4ed1-90dc-e59895924fe2', '3f25ac29-1f3f-4179-884e-0917a65772ba'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Delete snapshot completed successfully. Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8a414ab8-ca9f-4495-acf0-714b718c7e6b tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-99d3599a-0efc-403e-9359-a1bbd854d929-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-70022112-f63a-4daa-88aa-280fc893b3ce-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-70022112-f63a-4daa-88aa-280fc893b3ce-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d189fe-6b92-4db9-b133-b76e2cbb390a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:15 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce Apr 22 09:02:15 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:16 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce" returned: 0 in 0.546s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:16 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce Apr 22 09:02:16 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:16 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-70022112-f63a-4daa-88aa-280fc893b3ce" returned: 0 in 0.426s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-quobyte-70022112-f63a-4daa-88aa-280fc893b3ce" released by "delete_volume" :: held 1.012s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Created reservations ['41b2c8ce-8dfc-4a7a-90cd-067d761fc147', '62540b30-6344-4eac-bd7f-c318079b4c71', '5416678c-4ea1-4091-8755-1619c7a492c7', 'a4fd498b-a424-4838-b4ee-4e32e40a4931'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:16 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:02:16 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:17 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.413s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:17 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:02:17 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Deleted volume successfully. Apr 22 09:02:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a99d602d-ca80-488e-be7b-d68a019c07e6 tempest-VolumesSnapshotListTestJSON-982165386 None] Lock "cinder-70022112-f63a-4daa-88aa-280fc893b3ce-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:26 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=41,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=1 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:02:27 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=30,cinder:DELETE=4,cinder:UPDATE=37,cinder:INSERT=11 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Acquiring lock "cinder-b08d02eb-a926-49f5-aafc-1afb2c1402c3-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Lock "cinder-b08d02eb-a926-49f5-aafc-1afb2c1402c3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Acquiring lock "cinder-quobyte-b08d02eb-a926-49f5-aafc-1afb2c1402c3" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Lock "cinder-quobyte-b08d02eb-a926-49f5-aafc-1afb2c1402c3" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb908f-025c-4e2e-a8a8-800127e53e38]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:41 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 Apr 22 09:02:41 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:41 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3" returned: 0 in 0.528s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:41 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3 Apr 22 09:02:41 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:42 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b08d02eb-a926-49f5-aafc-1afb2c1402c3" returned: 0 in 0.456s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Lock "cinder-quobyte-b08d02eb-a926-49f5-aafc-1afb2c1402c3" released by "delete_volume" :: held 1.013s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Created reservations ['6f8b26bd-3767-4b95-8f94-b68e46884b00', 'd81fa2f8-fead-4fa8-a914-7ecde2975478', '7ff84a11-769b-42ce-b6bb-d1907b4c7b6d', 'dc4589f8-9c11-4245-9b8f-d5285d7a224e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:42 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:02:42 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:42 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.456s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:02:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Deleted volume successfully. Apr 22 09:02:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-bd258ef2-9ca5-4279-b9a8-16bb8f2aac1a tempest-VolumesNegativeTest-1608723246 None] Lock "cinder-b08d02eb-a926-49f5-aafc-1afb2c1402c3-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (b0d41b17-426c-4a4e-aa0d-4f27c6013b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cd5d68-3080-43e1-8824-7291d6f720be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cd5d68-3080-43e1-8824-7291d6f720be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1750212221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abba3b3-9187-4f69-87e6-22ee7d4980e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:50Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e04a94-8e3b-4bed-b054-55bdb63eb22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e04a94-8e3b-4bed-b054-55bdb63eb22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4299090e-88c3-4d98-9ab9-6f51db3ccd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4299090e-88c3-4d98-9ab9-6f51db3ccd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3abba3b3-9187-4f69-87e6-22ee7d4980e6', 'volume_name': 'volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd498a4b-37a6-4fed-84b1-f20600d8cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd498a4b-37a6-4fed-84b1-f20600d8cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759f06b7-21bf-43af-9db5-f1e572bb2e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Volume 3abba3b3-9187-4f69-87e6-22ee7d4980e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6', 'volume_size': 1} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1750212221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abba3b3-9187-4f69-87e6-22ee7d4980e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:50Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Creating volume 3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:02:49 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:02:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:50 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 1073741824 Apr 22 09:02:50 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:50 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 1073741824" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:50 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 Apr 22 09:02:50 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:50 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6" returned: 0 in 0.435s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759f06b7-21bf-43af-9db5-f1e572bb2e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755ef616-bbf1-4528-ab04-dc17396bfbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Volume volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 (3abba3b3-9187-4f69-87e6-22ee7d4980e6): created successfully Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755ef616-bbf1-4528-ab04-dc17396bfbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (b0d41b17-426c-4a4e-aa0d-4f27c6013b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:50 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-eda832a3-c4c2-4572-a180-6b701e31b515 tempest-VolumesSnapshotTestJSON-978998972 None] Created volume successfully. Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Creating offline snapshot b9e98be0-540e-4c37-ae87-99035b8f7d96 of volume 3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[130bac68-40ec-49e5-93b6-617900457562]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:52 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 Apr 22 09:02:52 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:52 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6" returned: 0 in 0.444s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:52 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 1G Apr 22 09:02:52 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:53 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 1G" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:53 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 Apr 22 09:02:53 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:53 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96" returned: 0 in 0.418s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:53 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 is being set with open permissions: ugo+rw Apr 22 09:02:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:53 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 Apr 22 09:02:53 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:53 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96" returned: 0 in 0.384s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:53 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info Apr 22 09:02:53 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:54 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:54 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info is being set with open permissions: ugo+rw Apr 22 09:02:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:54 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info Apr 22 09:02:54 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:54 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.info" returned: 0 in 0.392s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-83b3867c-6521-4091-bc0f-5195d60064a3 tempest-VolumesSnapshotTestJSON-978998972 None] Create snapshot completed successfully Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-b9e98be0-540e-4c37-ae87-99035b8f7d96-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-b9e98be0-540e-4c37-ae87-99035b8f7d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-3abba3b3-9187-4f69-87e6-22ee7d4980e6" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-3abba3b3-9187-4f69-87e6-22ee7d4980e6" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-b9e98be0-540e-4c37-ae87-99035b8f7d96" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-b9e98be0-540e-4c37-ae87-99035b8f7d96" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Deleting offline snapshot b9e98be0-540e-4c37-ae87-99035b8f7d96 of volume 3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] snapshot_file for this snap is: volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d51f5e9-b400-42fa-bb73-870a735dc4d6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:55 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 Apr 22 09:02:55 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:55 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46cdab5-ae54-40ea-ab5e-d57ed272cc19]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:56 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 Apr 22 09:02:56 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:56 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6" returned: 0 in 0.512s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:56 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 Apr 22 09:02:56 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:56 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96" returned: 0 in 0.429s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:56 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96 Apr 22 09:02:56 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:57 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6.b9e98be0-540e-4c37-ae87-99035b8f7d96" returned: 0 in 0.393s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-b9e98be0-540e-4c37-ae87-99035b8f7d96" released by "_delete_snapshot" :: held 1.831s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-3abba3b3-9187-4f69-87e6-22ee7d4980e6" released by "delete_snapshot" :: held 1.841s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['a1edf137-3fbf-4bcb-af0d-b03fd516a0d9', '70147166-6bd9-4009-be20-8118bbcca4d5', 'd1a17c5b-723f-4656-b295-aa54a5b2451f', '40f1b1d3-5dda-4cbb-99d4-1d9cb2dacc14'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:02:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Delete snapshot completed successfully. Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5ac69d63-725d-4b31-b0a2-eeef417c3cd2 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-b9e98be0-540e-4c37-ae87-99035b8f7d96-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (d5c00e7d-599c-4484-bc88-3650b63c28de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ca324-227e-4b38-95ce-541810ec1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ca324-227e-4b38-95ce-541810ec1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1856341974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f18bd4f-740a-49db-8f33-8e37e6dc042b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:58Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca190b1c-d83d-4cdc-818a-b206a3bc49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca190b1c-d83d-4cdc-818a-b206a3bc49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f332d08-36ae-49d4-954f-22c31ebd2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f332d08-36ae-49d4-954f-22c31ebd2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f18bd4f-740a-49db-8f33-8e37e6dc042b', 'volume_name': 'volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd39053-dd05-4310-af0d-c922cf5e097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd39053-dd05-4310-af0d-c922cf5e097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d899c4cb-c9b8-4638-9b0c-41b1d0353e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:57 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Volume 1f18bd4f-740a-49db-8f33-8e37e6dc042b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b', 'volume_size': 1} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1856341974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f18bd4f-740a-49db-8f33-8e37e6dc042b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:02:58Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Creating volume 1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:02:57 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:02:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:57 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b 1073741824 Apr 22 09:02:57 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:58 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b 1073741824" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:58 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:02:58 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:58 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.388s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d899c4cb-c9b8-4638-9b0c-41b1d0353e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b43ec3-dfc0-475e-b61d-a85c4bfa6414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:02:58 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Volume volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b (1f18bd4f-740a-49db-8f33-8e37e6dc042b): created successfully Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b43ec3-dfc0-475e-b61d-a85c4bfa6414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (d5c00e7d-599c-4484-bc88-3650b63c28de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:02:58 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-67575fe9-9d0e-4478-b57b-67f31ea80ec1 tempest-VolumesSnapshotTestJSON-978998972 None] Created volume successfully. Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Creating offline snapshot 4b2ff14d-1dfd-4997-9f86-53a520aa5592 of volume 1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[843190d3-6efc-4c12-90d0-465c70085d59]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:02:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:59 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:02:59 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:59 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:59 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 1G Apr 22 09:02:59 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:02:59 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Apr 22 09:02:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 1G" returned: 0 in 0.440s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:02:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:02:59 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 Apr 22 09:02:59 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:00 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:00 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 is being set with open permissions: ugo+rw Apr 22 09:03:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:00 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 Apr 22 09:03:00 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:00 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592" returned: 0 in 0.380s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:00 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info Apr 22 09:03:00 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:01 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info" returned: 0 in 0.403s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:01 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info is being set with open permissions: ugo+rw Apr 22 09:03:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:01 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info Apr 22 09:03:01 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:01 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.info" returned: 0 in 0.393s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:01 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-85f3acff-97f2-470b-92cd-462d0ca3d3fd tempest-VolumesSnapshotTestJSON-978998972 None] Create snapshot completed successfully Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (e604c452-1164-4a1d-b531-e1a0e9a51197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efba33c-bd02-4de8-98c7-bb0481a882ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efba33c-bd02-4de8-98c7-bb0481a882ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1477176287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee42dde-cd3f-49e4-afd4-1d649ed5cbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4b2ff14d-1dfd-4997-9f86-53a520aa5592,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:02Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f83e35-d950-4e5f-8ccf-e6880c300d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f83e35-d950-4e5f-8ccf-e6880c300d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc32507-6515-48a8-8a1b-9577fc10f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc32507-6515-48a8-8a1b-9577fc10f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fee42dde-cd3f-49e4-afd4-1d649ed5cbfc', 'volume_name': 'volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc', 'volume_size': 2, 'snapshot_id': '4b2ff14d-1dfd-4997-9f86-53a520aa5592'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1a2264-5fd8-4546-95b7-dcbbff8be3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1a2264-5fd8-4546-95b7-dcbbff8be3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3afc50-a106-4624-b032-591f4a29c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:02 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Volume fee42dde-cd3f-49e4-afd4-1d649ed5cbfc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc', 'volume_size': 2, 'snapshot_id': '4b2ff14d-1dfd-4997-9f86-53a520aa5592'} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-4b2ff14d-1dfd-4997-9f86-53a520aa5592-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-4b2ff14d-1dfd-4997-9f86-53a520aa5592-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Creating volume fee42dde-cd3f-49e4-afd4-1d649ed5cbfc from snapshot 4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] snapshot: 4b2ff14d-1dfd-4997-9f86-53a520aa5592, volume: fee42dde-cd3f-49e4-afd4-1d649ed5cbfc, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[0640ae3b-90a8-4a62-96d8-864a52636cdc]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:02 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 Apr 22 09:03:02 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:02 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb41b0c-7f22-4175-a46b-e5298571262e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:03 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:03:03 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:03 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:03 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:03:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:03 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc Apr 22 09:03:03 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:05 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" returned: 0 in 1.690s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:05 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2a0e9-5304-4929-803f-35cc7e06ecfe]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:05 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:03:05 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:05 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.561s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:05 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b, size 1024.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:03:05 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Converted 1024.00 MB image at 605.52 MB/s Apr 22 09:03:05 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc is being set with open permissions: ugo+rw Apr 22 09:03:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:05 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc Apr 22 09:03:05 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:06 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" returned: 0 in 0.379s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" released by "_copy_volume_from_snapshot" :: held 3.579s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-4b2ff14d-1dfd-4997-9f86-53a520aa5592-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" released by "_create_volume_from_snapshot" :: held 3.596s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.604s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3afc50-a106-4624-b032-591f4a29c591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc', 'volume_size': 2, 'snapshot_id': '4b2ff14d-1dfd-4997-9f86-53a520aa5592'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a5ef04-f527-4d76-b235-5652932f2b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:06 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Volume volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc (fee42dde-cd3f-49e4-afd4-1d649ed5cbfc): created successfully Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a5ef04-f527-4d76-b235-5652932f2b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (e604c452-1164-4a1d-b531-e1a0e9a51197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1eac0705-069a-46b6-a57f-1c22ed07366b tempest-VolumesSnapshotTestJSON-978998972 None] Created volume successfully. Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294b03b-8e2c-49f1-aae9-d3d9e54ef0e0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:06 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc Apr 22 09:03:06 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:07 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" returned: 0 in 0.451s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:07 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc Apr 22 09:03:07 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:07 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" returned: 0 in 0.386s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc" released by "delete_volume" :: held 0.858s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['ac1e7ba7-b2d5-477f-9cf6-08e9e824844b', '1ccf5c19-516b-4632-8e41-8afad128b315', 'bd4d0d92-125e-4e76-8820-30b61448b1f5', 'bdba78cc-6ad2-4238-bd93-3bed2e16c663'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:07 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:07 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-4b2ff14d-1dfd-4997-9f86-53a520aa5592-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-4b2ff14d-1dfd-4997-9f86-53a520aa5592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-1f18bd4f-740a-49db-8f33-8e37e6dc042b" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-1f18bd4f-740a-49db-8f33-8e37e6dc042b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-4b2ff14d-1dfd-4997-9f86-53a520aa5592" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-4b2ff14d-1dfd-4997-9f86-53a520aa5592" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Deleting offline snapshot 4b2ff14d-1dfd-4997-9f86-53a520aa5592 of volume 1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] snapshot_file for this snap is: volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abac6ba-b95a-4210-8952-6e1168ae2d1b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:07 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 Apr 22 09:03:07 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:08 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.442s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Deleted volume successfully. Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-0d9f35d1-ce84-4ddd-85da-0fecf3b2de27 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-fee42dde-cd3f-49e4-afd4-1d649ed5cbfc-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:08 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[da940d83-77bd-4d31-aab7-77aabb9284e8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:08 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:03:08 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:08 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:08 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 Apr 22 09:03:08 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:09 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592" returned: 0 in 0.436s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:09 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592 Apr 22 09:03:09 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:09 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b.4b2ff14d-1dfd-4997-9f86-53a520aa5592" returned: 0 in 0.383s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-4b2ff14d-1dfd-4997-9f86-53a520aa5592" released by "_delete_snapshot" :: held 1.791s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-1f18bd4f-740a-49db-8f33-8e37e6dc042b" released by "delete_snapshot" :: held 1.802s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['e6f52936-8bbc-452c-abdd-43d73d5340fa', '6a25bf02-6902-4cb1-adba-fe7e8f1a0117', '1f21f8be-3313-428d-b67a-5e480f7b3542', '20d6fe69-f102-45d7-b8f8-93bab0ef1ade'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Delete snapshot completed successfully. Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-d64b855d-5822-456c-a5dd-747abcf81085 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-4b2ff14d-1dfd-4997-9f86-53a520aa5592-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-1f18bd4f-740a-49db-8f33-8e37e6dc042b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-1f18bd4f-740a-49db-8f33-8e37e6dc042b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-1f18bd4f-740a-49db-8f33-8e37e6dc042b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-1f18bd4f-740a-49db-8f33-8e37e6dc042b" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f5ca0a-3e41-4a17-b607-61bd8f7a6960]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:10 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:03:10 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:10 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:10 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b Apr 22 09:03:10 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:10 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1f18bd4f-740a-49db-8f33-8e37e6dc042b" returned: 0 in 0.386s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-1f18bd4f-740a-49db-8f33-8e37e6dc042b" released by "delete_volume" :: held 0.870s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['2e278168-35a3-4802-8bda-f252636ec747', '131b81d9-6e95-440e-b152-16221b9bb764', '7d781f9f-bec5-44a8-be30-f4c5fa0b1e07', 'fc17d2b8-0831-41d4-bd4c-2adec80bf21f'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:10 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:10 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (f58c33ea-a264-465e-9ecd-3f108bd2754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0d190a-cb16-4701-9b8f-158cee5beb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:11 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0d190a-cb16-4701-9b8f-158cee5beb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-609088555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336608dd-dd8f-42e1-83ce-a595d5130c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:11Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43044a93-7248-4343-a6f8-e0b8588ea5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43044a93-7248-4343-a6f8-e0b8588ea5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e66101-d16b-4562-b8e6-8f75384e2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e66101-d16b-4562-b8e6-8f75384e2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336608dd-dd8f-42e1-83ce-a595d5130c2b', 'volume_name': 'volume-336608dd-dd8f-42e1-83ce-a595d5130c2b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307847ee-1341-4b50-b31f-7373e3e557fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307847ee-1341-4b50-b31f-7373e3e557fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47b852e-c2cd-4e34-addd-5acb4fcaeedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:11 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Volume 336608dd-dd8f-42e1-83ce-a595d5130c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336608dd-dd8f-42e1-83ce-a595d5130c2b', 'volume_size': 1} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-609088555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336608dd-dd8f-42e1-83ce-a595d5130c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:11Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Creating volume 336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:11 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:11 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Deleted volume successfully. Apr 22 09:03:11 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b 1073741824 Apr 22 09:03:11 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-48853120-5359-4121-b684-47c38d0b8602 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-1f18bd4f-740a-49db-8f33-8e37e6dc042b-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:11 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b 1073741824" returned: 0 in 0.443s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:11 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:11 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:12 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.395s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47b852e-c2cd-4e34-addd-5acb4fcaeedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336608dd-dd8f-42e1-83ce-a595d5130c2b', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6318010-74d1-45a3-978b-5d0f69bebb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:12 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Volume volume-336608dd-dd8f-42e1-83ce-a595d5130c2b (336608dd-dd8f-42e1-83ce-a595d5130c2b): created successfully Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6318010-74d1-45a3-978b-5d0f69bebb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (f58c33ea-a264-465e-9ecd-3f108bd2754f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3b056859-0077-489a-afe4-55c7abee5b7d tempest-VolumesSnapshotTestJSON-978998972 None] Created volume successfully. Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Creating offline snapshot c4e1f6d4-8c90-4d78-928b-a8640f8031c7 of volume 336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[722c0ce7-b2f8-4ca8-be76-e66192d2b85a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:12 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:12 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:12 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:12 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:12 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.441s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:12 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 1G Apr 22 09:03:12 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:13 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.387s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:13 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 1G" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336608dd-dd8f-42e1-83ce-a595d5130c2b -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:13 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336608dd-dd8f-42e1-83ce-a595d5130c2b -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 Apr 22 09:03:13 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:13 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336608dd-dd8f-42e1-83ce-a595d5130c2b -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7" returned: 0 in 0.406s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:13 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 is being set with open permissions: ugo+rw Apr 22 09:03:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:13 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 Apr 22 09:03:13 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:14 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7" returned: 0 in 0.385s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:14 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info Apr 22 09:03:14 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:14 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:14 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info is being set with open permissions: ugo+rw Apr 22 09:03:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:14 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info Apr 22 09:03:14 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:14 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.info" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-83999a46-1909-424e-af4b-52b55667768e tempest-VolumesSnapshotTestJSON-978998972 None] Create snapshot completed successfully Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (6633fc64-11bd-457c-a8bc-30f655dee3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ad33e7-16cf-4efc-aef8-5f5a3c8c8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ad33e7-16cf-4efc-aef8-5f5a3c8c8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1523564427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983b4f58-9f56-4de8-9948-3be9fd8116ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a624e013256346bf84592c44f619051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4e1f6d4-8c90-4d78-928b-a8640f8031c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:16Z,use_quota=True,user_id='cf74044a286f474c9bfbc905b6b3d6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a63fb9-ea86-4ac4-bc9e-5453aba580ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a63fb9-ea86-4ac4-bc9e-5453aba580ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053049a4-6c35-4abc-b4f3-d68185ff3447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053049a4-6c35-4abc-b4f3-d68185ff3447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '983b4f58-9f56-4de8-9948-3be9fd8116ea', 'volume_name': 'volume-983b4f58-9f56-4de8-9948-3be9fd8116ea', 'volume_size': 1, 'snapshot_id': 'c4e1f6d4-8c90-4d78-928b-a8640f8031c7'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95d1573-a44f-48fe-bb69-c219829f7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95d1573-a44f-48fe-bb69-c219829f7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaf0a00-010a-4d9e-abc1-b65851479d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:15 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Volume 983b4f58-9f56-4de8-9948-3be9fd8116ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-983b4f58-9f56-4de8-9948-3be9fd8116ea', 'volume_size': 1, 'snapshot_id': 'c4e1f6d4-8c90-4d78-928b-a8640f8031c7'} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-c4e1f6d4-8c90-4d78-928b-a8640f8031c7-983b4f58-9f56-4de8-9948-3be9fd8116ea" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-c4e1f6d4-8c90-4d78-928b-a8640f8031c7-983b4f58-9f56-4de8-9948-3be9fd8116ea" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Creating volume 983b4f58-9f56-4de8-9948-3be9fd8116ea from snapshot c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-983b4f58-9f56-4de8-9948-3be9fd8116ea" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-983b4f58-9f56-4de8-9948-3be9fd8116ea" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] snapshot: c4e1f6d4-8c90-4d78-928b-a8640f8031c7, volume: 983b4f58-9f56-4de8-9948-3be9fd8116ea, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19241eb-63c6-4158-85ef-09614185dbd8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:16 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 Apr 22 09:03:16 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:16 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336608dd-dd8f-42e1-83ce-a595d5130c2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a84169-99fb-403e-afaf-48992bfb2845]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:16 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:16 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:16 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:03:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:16 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea Apr 22 09:03:16 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:18 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea" returned: 0 in 1.790s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aae59d-8edb-4718-aa68-3190a387e72f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:18 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:18 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:19 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.574s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:03:19 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Converted 1024.00 MB image at 571.63 MB/s Apr 22 09:03:19 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea is being set with open permissions: ugo+rw Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:19 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea Apr 22 09:03:19 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:19 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea" returned: 0 in 0.384s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-983b4f58-9f56-4de8-9948-3be9fd8116ea" released by "_copy_volume_from_snapshot" :: held 3.709s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-c4e1f6d4-8c90-4d78-928b-a8640f8031c7-983b4f58-9f56-4de8-9948-3be9fd8116ea" released by "_create_volume_from_snapshot" :: held 3.725s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.733s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaf0a00-010a-4d9e-abc1-b65851479d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983b4f58-9f56-4de8-9948-3be9fd8116ea', 'volume_size': 1, 'snapshot_id': 'c4e1f6d4-8c90-4d78-928b-a8640f8031c7'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e9b882-9186-4605-8da4-793d9b32e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:19 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Volume volume-983b4f58-9f56-4de8-9948-3be9fd8116ea (983b4f58-9f56-4de8-9948-3be9fd8116ea): created successfully Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e9b882-9186-4605-8da4-793d9b32e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:19 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Flow 'volume_create_manager' (6633fc64-11bd-457c-a8bc-30f655dee3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:19 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1d6bf84b-71b5-474f-94c8-ce703e78a83f tempest-VolumesSnapshotTestJSON-978998972 None] Created volume successfully. Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-983b4f58-9f56-4de8-9948-3be9fd8116ea-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-983b4f58-9f56-4de8-9948-3be9fd8116ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-983b4f58-9f56-4de8-9948-3be9fd8116ea" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-983b4f58-9f56-4de8-9948-3be9fd8116ea" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e1cc7-685a-4b28-a4a3-57a7c63f89ee]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:20 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea Apr 22 09:03:20 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:20 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:20 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea Apr 22 09:03:20 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:21 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-983b4f58-9f56-4de8-9948-3be9fd8116ea" returned: 0 in 0.396s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-983b4f58-9f56-4de8-9948-3be9fd8116ea" released by "delete_volume" :: held 0.868s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['35dfaa0b-0320-4494-a838-43053ed6dfbb', 'e142d48d-9c4a-4301-92f2-7718a73fb9a9', '9e6431f4-d160-42a9-892a-bb63c39f04cd', 'a3ac5d4f-b8c8-46c6-bfe1-141a5189fa36'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:21 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:21 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-c4e1f6d4-8c90-4d78-928b-a8640f8031c7-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-c4e1f6d4-8c90-4d78-928b-a8640f8031c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-336608dd-dd8f-42e1-83ce-a595d5130c2b" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-336608dd-dd8f-42e1-83ce-a595d5130c2b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-c4e1f6d4-8c90-4d78-928b-a8640f8031c7" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-c4e1f6d4-8c90-4d78-928b-a8640f8031c7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Deleting offline snapshot c4e1f6d4-8c90-4d78-928b-a8640f8031c7 of volume 336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] snapshot_file for this snap is: volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4de696-eea4-424c-ad9c-9f113427332b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:21 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 Apr 22 09:03:21 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:21 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.418s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Deleted volume successfully. Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-f7b566a0-dac1-428d-a600-b1559a3aa179 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-983b4f58-9f56-4de8-9948-3be9fd8116ea-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:21 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336608dd-dd8f-42e1-83ce-a595d5130c2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1e9d43-900c-4f21-9eb5-983d7c91c70e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:21 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:21 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:22 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.479s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:22 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 Apr 22 09:03:22 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:22 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7" returned: 0 in 0.419s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:22 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7 Apr 22 09:03:22 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:23 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b.c4e1f6d4-8c90-4d78-928b-a8640f8031c7" returned: 0 in 0.387s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-c4e1f6d4-8c90-4d78-928b-a8640f8031c7" released by "_delete_snapshot" :: held 1.807s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-336608dd-dd8f-42e1-83ce-a595d5130c2b" released by "delete_snapshot" :: held 1.820s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['1d5c4436-a02f-423f-82b9-e2c0f7ff2dc6', 'fb7e234e-74b8-4375-839d-9a9794b629af', '16df91e0-3089-4ead-8f2a-3a870bdba1b2', 'a6e1ca3f-4e6c-4b96-a136-fcf82c0edfee'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:23 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Delete snapshot completed successfully. Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ae7bbe6f-9311-429d-85e0-772627067693 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-c4e1f6d4-8c90-4d78-928b-a8640f8031c7-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-336608dd-dd8f-42e1-83ce-a595d5130c2b-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-336608dd-dd8f-42e1-83ce-a595d5130c2b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-336608dd-dd8f-42e1-83ce-a595d5130c2b" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-336608dd-dd8f-42e1-83ce-a595d5130c2b" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3def20-bf7b-4242-9b33-5ce30ba6f815]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:23 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:23 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:23 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.446s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:23 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b Apr 22 09:03:23 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:24 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-336608dd-dd8f-42e1-83ce-a595d5130c2b" returned: 0 in 0.394s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-336608dd-dd8f-42e1-83ce-a595d5130c2b" released by "delete_volume" :: held 0.868s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['62d44976-7e61-4f44-943b-756dec962343', '4b1fef8c-7154-446c-bb03-ced99eb4c3b6', '51235bd3-89e6-4446-a81c-504a4d57a7e8', 'b928d01d-9be7-4363-ba78-3c6a6e83aed5'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:24 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:24 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-3abba3b3-9187-4f69-87e6-22ee7d4980e6-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-3abba3b3-9187-4f69-87e6-22ee7d4980e6-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "cinder-quobyte-3abba3b3-9187-4f69-87e6-22ee7d4980e6" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-3abba3b3-9187-4f69-87e6-22ee7d4980e6" acquired by "delete_volume" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8927cf8-71bc-4730-98e4-022e09c879fe]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:24 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 Apr 22 09:03:24 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:24 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.411s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:24 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Deleted volume successfully. Apr 22 09:03:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e0d2d8a2-a436-49c3-b2b3-44a313634bb5 tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-336608dd-dd8f-42e1-83ce-a595d5130c2b-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:25 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:25 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6 Apr 22 09:03:25 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:25 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3abba3b3-9187-4f69-87e6-22ee7d4980e6" returned: 0 in 0.411s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-quobyte-3abba3b3-9187-4f69-87e6-22ee7d4980e6" released by "delete_volume" :: held 0.897s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Created reservations ['e31471fc-883b-49c3-9a31-296935c9cba0', 'd72d0a48-c951-4362-ae8c-0da0affd0f7a', '428fb94c-203d-41b4-a98c-da82d179aae6', '3331de95-c48f-45d2-a93e-706f3dcee628'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:25 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:25 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:26 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:26 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:26 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Deleted volume successfully. Apr 22 09:03:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7a0e5dec-94be-4f70-a7d4-9530b0e2fd7a tempest-VolumesSnapshotTestJSON-978998972 None] Lock "cinder-3abba3b3-9187-4f69-87e6-22ee7d4980e6-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (eb1984a7-fd30-4006-bcfa-2be0cf95ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4473ffe2-463e-45c7-9322-1d3394cf64a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4473ffe2-463e-45c7-9322-1d3394cf64a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1608722363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d3f8fd-ca42-4cda-8c05-44bbc9a375c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:29Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a1da18-5eb9-4e7a-bf75-6dfa487f125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a1da18-5eb9-4e7a-bf75-6dfa487f125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1c6863-924d-41fa-9e19-7a956f8fa074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1c6863-924d-41fa-9e19-7a956f8fa074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d3f8fd-ca42-4cda-8c05-44bbc9a375c9', 'volume_name': 'volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f52668-b85b-4443-a047-4ade1524f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f52668-b85b-4443-a047-4ade1524f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1197e69b-4234-4ece-b337-cb9ced885896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:29 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume 36d3f8fd-ca42-4cda-8c05-44bbc9a375c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9', 'volume_size': 1} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1608722363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d3f8fd-ca42-4cda-8c05-44bbc9a375c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:29Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating volume 36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:29 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:29 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 1073741824 Apr 22 09:03:29 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:29 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 1073741824" returned: 0 in 0.468s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:29 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 Apr 22 09:03:29 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:29 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" returned: 0 in 0.404s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1197e69b-4234-4ece-b337-cb9ced885896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e7e798-f39b-48d5-99e6-c31aff16a335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:29 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 (36d3f8fd-ca42-4cda-8c05-44bbc9a375c9): created successfully Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e7e798-f39b-48d5-99e6-c31aff16a335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (eb1984a7-fd30-4006-bcfa-2be0cf95ef81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:30 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-0d031b1f-a986-4301-8f08-fe8a4c46d2da tempest-CreateVolumesFromSnapshotTest-610048377 None] Created volume successfully. Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating offline snapshot 5538a090-9fb0-4226-a519-d0fc92aaa24b of volume 36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb46b4e-337a-40e9-ab68-7d626b5b6590]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:30 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 Apr 22 09:03:30 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:30 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:30 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b 1G Apr 22 09:03:30 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:31 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b 1G" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:31 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b Apr 22 09:03:31 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:31 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b" returned: 0 in 0.425s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:31 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b is being set with open permissions: ugo+rw Apr 22 09:03:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:31 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b Apr 22 09:03:31 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:31 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b" returned: 0 in 0.389s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:31 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info Apr 22 09:03:31 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:32 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:32 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info is being set with open permissions: ugo+rw Apr 22 09:03:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:32 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info Apr 22 09:03:32 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:32 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.info" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a026a7bf-606f-42bd-8af1-5ef3edb07fa2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Create snapshot completed successfully Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (74dc8f1e-92aa-4037-9b39-25bd57635f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7a9422-c70d-4049-a01a-b326dcc3d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7a9422-c70d-4049-a01a-b326dcc3d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1961828135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3142eda3-3184-4749-9f9d-aa4886b41aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:33Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1850ddd2-a28f-4d83-98c3-0726d9013f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1850ddd2-a28f-4d83-98c3-0726d9013f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50753ba4-9960-40cd-9c42-a659819d3c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50753ba4-9960-40cd-9c42-a659819d3c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3142eda3-3184-4749-9f9d-aa4886b41aed', 'volume_name': 'volume-3142eda3-3184-4749-9f9d-aa4886b41aed', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d164694f-4b76-4b7c-894f-ef4d7bd0fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d164694f-4b76-4b7c-894f-ef4d7bd0fc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a524870-adcf-46b5-9404-ff25b5d09aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume 3142eda3-3184-4749-9f9d-aa4886b41aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3142eda3-3184-4749-9f9d-aa4886b41aed', 'volume_size': 1} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1961828135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3142eda3-3184-4749-9f9d-aa4886b41aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:33Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating volume 3142eda3-3184-4749-9f9d-aa4886b41aed {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:33 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:33 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed 1073741824 Apr 22 09:03:33 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (5db15a50-f836-4b14-ba2c-52c0a0cc597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c76a86-03be-480a-9a2f-e87ab44fcbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c76a86-03be-480a-9a2f-e87ab44fcbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-420922858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6107d702-b1c2-4d8b-98fc-7eb3b7a5db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d502a1d-a2ff-40df-9705-55e61f065786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d502a1d-a2ff-40df-9705-55e61f065786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acff25b-c9be-4db0-ac93-36fd44b0e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acff25b-c9be-4db0-ac93-36fd44b0e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6107d702-b1c2-4d8b-98fc-7eb3b7a5db06', 'volume_name': 'volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15014ea5-2159-4d9b-a866-c2f82bf1b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15014ea5-2159-4d9b-a866-c2f82bf1b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf83f62-6618-4db2-b948-6980508a548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume 6107d702-b1c2-4d8b-98fc-7eb3b7a5db06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06', 'volume_size': 1} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (cfbe8cb0-8657-4fb8-a8a9-4e9be0e1e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b79081d-c443-4716-a633-4c4e7369c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b79081d-c443-4716-a633-4c4e7369c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983622714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bbe21f-89ef-4706-88c5-82a60a800589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db90ca12-ef73-463d-be60-22308fb4e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db90ca12-ef73-463d-be60-22308fb4e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3866e01f-a54a-4686-a806-d151e76e00eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3866e01f-a54a-4686-a806-d151e76e00eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1bbe21f-89ef-4706-88c5-82a60a800589', 'volume_name': 'volume-d1bbe21f-89ef-4706-88c5-82a60a800589', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3adc16-a007-4c54-bfca-930570fd2164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3adc16-a007-4c54-bfca-930570fd2164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3986f5e8-9a8e-4469-8e52-464e2327e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume d1bbe21f-89ef-4706-88c5-82a60a800589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1bbe21f-89ef-4706-88c5-82a60a800589', 'volume_size': 1} Apr 22 09:03:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (8bb29813-e71b-4c73-bf0c-8b5170f99a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d49cd0-e233-4b24-91cf-954a8b853d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d49cd0-e233-4b24-91cf-954a8b853d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-880061822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033a96b7-4206-483e-9a92-2e9fe64b571e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46ff19-5d07-4da0-aa6e-6475d4305104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46ff19-5d07-4da0-aa6e-6475d4305104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778db286-bcc3-4d5c-b4a3-72e5c7a002dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778db286-bcc3-4d5c-b4a3-72e5c7a002dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '033a96b7-4206-483e-9a92-2e9fe64b571e', 'volume_name': 'volume-033a96b7-4206-483e-9a92-2e9fe64b571e', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb53515-4401-4437-b232-e59ef5db4671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb53515-4401-4437-b232-e59ef5db4671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c2503d-dc18-4002-8775-9387960d4390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume 033a96b7-4206-483e-9a92-2e9fe64b571e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-033a96b7-4206-483e-9a92-2e9fe64b571e', 'volume_size': 1} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed 1073741824" returned: 0 in 0.588s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:34 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed Apr 22 09:03:34 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (2d71fa44-256c-4dcd-a0ac-b852b2e21545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40ffc89-5f7a-471e-8dff-19fc92e9b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40ffc89-5f7a-471e-8dff-19fc92e9b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192158690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c2b195-c991-45cf-b07f-627beaf39397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f390cd-2fc1-470e-88a1-e18a82cbdfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f390cd-2fc1-470e-88a1-e18a82cbdfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd354a45-d328-41af-b174-c5a9f9fa25f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd354a45-d328-41af-b174-c5a9f9fa25f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c2b195-c991-45cf-b07f-627beaf39397', 'volume_name': 'volume-61c2b195-c991-45cf-b07f-627beaf39397', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adf5895-bf32-4882-a8ec-dceb7871af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adf5895-bf32-4882-a8ec-dceb7871af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a2e8c7-52f7-40e8-a6f2-abb65e9d764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume 61c2b195-c991-45cf-b07f-627beaf39397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c2b195-c991-45cf-b07f-627beaf39397', 'volume_size': 1} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:34 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed" returned: 0 in 0.396s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-420922858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6107d702-b1c2-4d8b-98fc-7eb3b7a5db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating volume 6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:34 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a524870-adcf-46b5-9404-ff25b5d09aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3142eda3-3184-4749-9f9d-aa4886b41aed', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 1073741824 Apr 22 09:03:34 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c047de39-df0e-4c69-938f-19d217502457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume volume-3142eda3-3184-4749-9f9d-aa4886b41aed (3142eda3-3184-4749-9f9d-aa4886b41aed): created successfully Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c047de39-df0e-4c69-938f-19d217502457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (74dc8f1e-92aa-4037-9b39-25bd57635f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-d26e3105-b527-46e0-a7ee-bc5800e8cad7 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created volume successfully. Apr 22 09:03:35 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 1073741824" returned: 0 in 0.495s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:35 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 Apr 22 09:03:35 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:35 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06" returned: 0 in 0.394s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.563s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983622714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bbe21f-89ef-4706-88c5-82a60a800589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating volume d1bbe21f-89ef-4706-88c5-82a60a800589 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:35 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf83f62-6618-4db2-b948-6980508a548e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8f344a-61ae-4144-971e-c27c60ca28e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:35 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 1073741824 Apr 22 09:03:35 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:35 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 (6107d702-b1c2-4d8b-98fc-7eb3b7a5db06): created successfully Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8f344a-61ae-4144-971e-c27c60ca28e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (5db15a50-f836-4b14-ba2c-52c0a0cc597d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:35 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-80414421-e8ad-4842-b044-f50242745c4d tempest-CreateVolumesFromSnapshotTest-610048377 None] Created volume successfully. Apr 22 09:03:35 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 1073741824" returned: 0 in 0.451s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:35 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 Apr 22 09:03:35 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:36 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589" returned: 0 in 0.439s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-880061822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033a96b7-4206-483e-9a92-2e9fe64b571e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating volume 033a96b7-4206-483e-9a92-2e9fe64b571e {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:36 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3986f5e8-9a8e-4469-8e52-464e2327e155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1bbe21f-89ef-4706-88c5-82a60a800589', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd21bc71-ff29-4101-8fcb-22e6495db08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:36 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e 1073741824 Apr 22 09:03:36 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:36 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume volume-d1bbe21f-89ef-4706-88c5-82a60a800589 (d1bbe21f-89ef-4706-88c5-82a60a800589): created successfully Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd21bc71-ff29-4101-8fcb-22e6495db08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (cfbe8cb0-8657-4fb8-a8a9-4e9be0e1e20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-83e28e1d-969a-4dd2-b634-13e2237d9827 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created volume successfully. Apr 22 09:03:36 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e 1073741824" returned: 0 in 0.468s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:36 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e Apr 22 09:03:36 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:37 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e" returned: 0 in 0.408s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.021s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192158690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c2b195-c991-45cf-b07f-627beaf39397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcad8dcd779c4312a5f3c7f2a159c08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:34Z,use_quota=True,user_id='2c9289d665fc453481e2f8b27f752b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Creating volume 61c2b195-c991-45cf-b07f-627beaf39397 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:37 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c2503d-dc18-4002-8775-9387960d4390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-033a96b7-4206-483e-9a92-2e9fe64b571e', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de296153-ad4c-45e0-b4f0-232c229b9a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:37 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 1073741824 Apr 22 09:03:37 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:37 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume volume-033a96b7-4206-483e-9a92-2e9fe64b571e (033a96b7-4206-483e-9a92-2e9fe64b571e): created successfully Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de296153-ad4c-45e0-b4f0-232c229b9a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (8bb29813-e71b-4c73-bf0c-8b5170f99a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=84,cinder:INSERT=27,cinder:UPDATE=97,cinder:DELETE=10 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:03:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3cf11167-de4c-425c-be33-90593fd43ed4 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created volume successfully. Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=103,cinder:SELECT=94,cinder:INSERT=21,cinder:DELETE=10 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:03:37 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 1073741824" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:37 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 Apr 22 09:03:37 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:38 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397" returned: 0 in 0.402s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a2e8c7-52f7-40e8-a6f2-abb65e9d764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c2b195-c991-45cf-b07f-627beaf39397', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f183659b-9a2d-4ba8-b4b4-cabcd523e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:38 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Volume volume-61c2b195-c991-45cf-b07f-627beaf39397 (61c2b195-c991-45cf-b07f-627beaf39397): created successfully Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f183659b-9a2d-4ba8-b4b4-cabcd523e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Flow 'volume_create_manager' (2d71fa44-256c-4dcd-a0ac-b852b2e21545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2fc6df3a-223f-4dc8-bd09-e3883122dcec tempest-CreateVolumesFromSnapshotTest-610048377 None] Created volume successfully. Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-61c2b195-c991-45cf-b07f-627beaf39397-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-61c2b195-c991-45cf-b07f-627beaf39397-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-61c2b195-c991-45cf-b07f-627beaf39397" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-61c2b195-c991-45cf-b07f-627beaf39397" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762cc4e-59bf-4b20-99bb-a7cd2d1e244c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:38 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 Apr 22 09:03:38 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:39 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:39 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397 Apr 22 09:03:39 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:39 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-61c2b195-c991-45cf-b07f-627beaf39397" returned: 0 in 0.386s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-61c2b195-c991-45cf-b07f-627beaf39397" released by "delete_volume" :: held 0.862s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['051284f7-b880-46f6-b462-7371fefa6e62', '393c0588-b843-4603-9699-8b34136b9e8e', 'cd078dfa-e810-443a-b039-619bcb14f9e1', '7944bac6-a483-4839-927b-ce326f93c342'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:39 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:39 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-033a96b7-4206-483e-9a92-2e9fe64b571e-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-033a96b7-4206-483e-9a92-2e9fe64b571e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-033a96b7-4206-483e-9a92-2e9fe64b571e" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-033a96b7-4206-483e-9a92-2e9fe64b571e" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09d75a-e12b-49f1-b8c7-3e2339b4a053]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:39 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e Apr 22 09:03:39 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:39 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.410s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:39 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleted volume successfully. Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-5baef634-06e1-4c0e-9285-4b65565d84e2 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-61c2b195-c991-45cf-b07f-627beaf39397-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:40 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:40 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e Apr 22 09:03:40 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:40 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-033a96b7-4206-483e-9a92-2e9fe64b571e" returned: 0 in 0.388s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-033a96b7-4206-483e-9a92-2e9fe64b571e" released by "delete_volume" :: held 0.872s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['f99108c3-3eaa-4364-a1e2-17a8eab3d50d', '71ae7f3a-e4d0-4532-8153-d4d840883d33', '83693b91-88d4-499a-92bb-ed35476ed263', '2e375a18-0564-4dd2-99ce-b387f284a196'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:40 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:40 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-d1bbe21f-89ef-4706-88c5-82a60a800589-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-d1bbe21f-89ef-4706-88c5-82a60a800589-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-d1bbe21f-89ef-4706-88c5-82a60a800589" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-d1bbe21f-89ef-4706-88c5-82a60a800589" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a3440-9373-464c-a1a3-6aa140c69a99]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:40 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 Apr 22 09:03:40 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:41 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.442s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleted volume successfully. Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10681bc9-33b1-41b6-b80e-08b2a9868ddf tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-033a96b7-4206-483e-9a92-2e9fe64b571e-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:41 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589" returned: 0 in 0.486s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:41 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589 Apr 22 09:03:41 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:41 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-d1bbe21f-89ef-4706-88c5-82a60a800589" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-d1bbe21f-89ef-4706-88c5-82a60a800589" released by "delete_volume" :: held 0.896s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['15d9a42b-f5ab-4bcc-bef8-1ff651fa2bd9', '854f2197-5df4-4ca7-a0d8-f5ebf7d25cfc', '04ce7dc9-598f-4d3b-bcc5-e9be7b38ed1f', '51c4cfd8-7c27-475f-a5fa-1b102dee14db'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:41 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:41 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0723a7-3df0-40fd-9321-345547da9b74]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:42 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 Apr 22 09:03:42 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:42 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleted volume successfully. Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6411fbe2-43b6-46a1-bc84-84d95919f113 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-d1bbe21f-89ef-4706-88c5-82a60a800589-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:42 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06" returned: 0 in 0.481s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:42 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06 Apr 22 09:03:42 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:42 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06" released by "delete_volume" :: held 0.890s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['cf042d00-b7b2-42d1-8b5d-e31db9428b1e', '72abd2c6-9796-463e-b5eb-bab25d293c63', '77b0359f-62e7-45a5-87db-dc8e993fb790', '1cfa5d40-4fd4-4b8b-8415-7ba0f67e5d29'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:42 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:42 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-3142eda3-3184-4749-9f9d-aa4886b41aed-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-3142eda3-3184-4749-9f9d-aa4886b41aed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-3142eda3-3184-4749-9f9d-aa4886b41aed" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-3142eda3-3184-4749-9f9d-aa4886b41aed" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b366a9e5-dd15-4349-91d6-62e1dfc5084b]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:43 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed Apr 22 09:03:43 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:43 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.418s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleted volume successfully. Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-667365b1-e938-45c2-bd86-c0f090eb181e tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-6107d702-b1c2-4d8b-98fc-7eb3b7a5db06-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:43 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:43 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed Apr 22 09:03:43 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:44 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-3142eda3-3184-4749-9f9d-aa4886b41aed" returned: 0 in 0.398s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-3142eda3-3184-4749-9f9d-aa4886b41aed" released by "delete_volume" :: held 0.925s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['842b3e46-bfee-4eef-82bd-1c2d8caaa6c6', '9eff52d2-ede4-4808-ae60-088d7874d193', 'a76969d5-129f-4e04-8640-315f1668aaca', '1b2c3e00-dc52-42f2-912d-8e0694c8b21e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:44 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:44 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-5538a090-9fb0-4226-a519-d0fc92aaa24b-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-5538a090-9fb0-4226-a519-d0fc92aaa24b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-5538a090-9fb0-4226-a519-d0fc92aaa24b" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-5538a090-9fb0-4226-a519-d0fc92aaa24b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleting offline snapshot 5538a090-9fb0-4226-a519-d0fc92aaa24b of volume 36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] snapshot_file for this snap is: volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1289b640-6acc-4ce3-a5a3-2e194b0f4581]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:44 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b Apr 22 09:03:44 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:44 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.402s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:44 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleted volume successfully. Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-480406fb-d41c-4693-aca0-0b80d2e8ca87 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-3142eda3-3184-4749-9f9d-aa4886b41aed-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:44 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b" returned: 0 in 0.459s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[837148a3-d65d-4766-b077-737c30543856]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:44 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 Apr 22 09:03:44 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:45 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" returned: 0 in 0.471s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:45 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b Apr 22 09:03:45 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:45 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b" returned: 0 in 0.432s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:45 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b Apr 22 09:03:45 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:45 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9.5538a090-9fb0-4226-a519-d0fc92aaa24b" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-5538a090-9fb0-4226-a519-d0fc92aaa24b" released by "_delete_snapshot" :: held 1.802s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" released by "delete_snapshot" :: held 1.814s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['d0cf2333-c62a-4133-bf0e-48124e3f4e7b', '53b48520-ccd2-4681-8683-8d2b775b068f', '4ce9cdd0-b068-4cf5-b4af-ec9682a9b04a', '5c1d3872-24c2-4a0e-aa97-b48fb7b83814'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Delete snapshot completed successfully. Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-dff3705c-5d80-4c3c-870e-abef2a90b2e8 tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-5538a090-9fb0-4226-a519-d0fc92aaa24b-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "cinder-quobyte-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[97841119-eae6-4fb4-bce4-c0c4a3753110]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:46 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 Apr 22 09:03:46 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:46 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" returned: 0 in 0.451s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:46 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9 Apr 22 09:03:46 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:47 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" returned: 0 in 0.392s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-quobyte-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9" released by "delete_volume" :: held 0.876s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Created reservations ['3ef2595d-aba1-4081-bc4d-b41342a8ffa1', '9a2c4da2-97d9-4916-9ae9-02b8a200c291', '2a461e42-5c7d-4645-8fb3-6c181bb85778', 'ceaf7f43-daf5-4de8-93c8-d6d45ceabe3d'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:47 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:47 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:47 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:47 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Deleted volume successfully. Apr 22 09:03:47 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-287b9d6b-1707-4117-b58c-5f42d24364aa tempest-CreateVolumesFromSnapshotTest-610048377 None] Lock "cinder-36d3f8fd-ca42-4cda-8c05-44bbc9a375c9-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:48 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (5ba17345-9d72-4bcc-b9a5-b29eb5198d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f760d9-678e-482d-a72c-64a192740af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f760d9-678e-482d-a72c-64a192740af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234069596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65cafdb-d83e-40d6-a38b-93255cfd9135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:49Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d2b3e6-f653-45dc-b048-e75822f1f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d2b3e6-f653-45dc-b048-e75822f1f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8302a03-ba26-4eaf-bd42-54bfe7777f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8302a03-ba26-4eaf-bd42-54bfe7777f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65cafdb-d83e-40d6-a38b-93255cfd9135', 'volume_name': 'volume-f65cafdb-d83e-40d6-a38b-93255cfd9135', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee945465-cf1f-4b8c-92d0-ee79bcafe2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee945465-cf1f-4b8c-92d0-ee79bcafe2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08eee3c9-54d3-4e84-8b03-13bc577ba1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume f65cafdb-d83e-40d6-a38b-93255cfd9135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65cafdb-d83e-40d6-a38b-93255cfd9135', 'volume_size': 1} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234069596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65cafdb-d83e-40d6-a38b-93255cfd9135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:49Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Creating volume f65cafdb-d83e-40d6-a38b-93255cfd9135 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:49 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:49 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 1073741824 Apr 22 09:03:49 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:49 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 1073741824" returned: 0 in 0.468s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:49 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 Apr 22 09:03:49 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:49 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135" returned: 0 in 0.392s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08eee3c9-54d3-4e84-8b03-13bc577ba1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65cafdb-d83e-40d6-a38b-93255cfd9135', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708c1e75-1aa0-4a62-afb6-e0e295b35950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:49 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 (f65cafdb-d83e-40d6-a38b-93255cfd9135): created successfully Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708c1e75-1aa0-4a62-afb6-e0e295b35950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:49 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (5ba17345-9d72-4bcc-b9a5-b29eb5198d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:49 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-68138f44-7e00-46d8-a881-514b4d998577 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created volume successfully. Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (17f4d477-30fb-4891-b34e-78f8a902d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cdee6c-8525-4de6-b217-2ef082223e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cdee6c-8525-4de6-b217-2ef082223e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601404973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaed879-e6f5-47c1-aef4-f54a3c1128fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:50Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ab7c0a-2160-4743-91a8-f86d9a273c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ab7c0a-2160-4743-91a8-f86d9a273c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001ca85f-ff18-4f09-bb7e-4646283a15bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001ca85f-ff18-4f09-bb7e-4646283a15bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aaed879-e6f5-47c1-aef4-f54a3c1128fc', 'volume_name': 'volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00023093-37ae-4116-88d0-8c85084bb565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00023093-37ae-4116-88d0-8c85084bb565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9765d80f-b8ba-4c90-bb51-6b5963c5674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume 1aaed879-e6f5-47c1-aef4-f54a3c1128fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc', 'volume_size': 1} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601404973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaed879-e6f5-47c1-aef4-f54a3c1128fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:50Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Creating volume 1aaed879-e6f5-47c1-aef4-f54a3c1128fc {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:50 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:50 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc 1073741824 Apr 22 09:03:50 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (fadd326c-2239-4aaf-b7e6-76b30de07824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a8b639-df7f-47bb-a621-0fdd38c7e54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a8b639-df7f-47bb-a621-0fdd38c7e54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926277006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bdc44ae-8841-4b1c-9882-0e4433c8dd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:50Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e691bc8-6347-41d6-94af-d02f94e956f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e691bc8-6347-41d6-94af-d02f94e956f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd494e3c-7942-46d8-a69b-c2a4e2f8e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd494e3c-7942-46d8-a69b-c2a4e2f8e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bdc44ae-8841-4b1c-9882-0e4433c8dd43', 'volume_name': 'volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc95a307-eb22-480d-9f0d-eb393ef9d343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc95a307-eb22-480d-9f0d-eb393ef9d343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a3d80-eedd-466a-a8ba-f92ff552c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume 1bdc44ae-8841-4b1c-9882-0e4433c8dd43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43', 'volume_size': 1} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (30830d33-533f-49b7-9ff2-396e47f7ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937596d6-c110-4786-ac2e-24fb97471891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937596d6-c110-4786-ac2e-24fb97471891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18678148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6532ffe-58af-4b68-bc74-2cbc09d3f087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:51Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e619062e-53a0-472f-8ad9-5820f6f28dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e619062e-53a0-472f-8ad9-5820f6f28dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4539075a-bd41-409a-939e-7b72dc0610cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4539075a-bd41-409a-939e-7b72dc0610cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6532ffe-58af-4b68-bc74-2cbc09d3f087', 'volume_name': 'volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f67ff1d-ffaa-41d0-b2db-7c5048b44e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f67ff1d-ffaa-41d0-b2db-7c5048b44e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9138fbb6-beaf-48c6-ae9a-a0fcdb541b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume f6532ffe-58af-4b68-bc74-2cbc09d3f087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087', 'volume_size': 1} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (ab722b68-4409-451d-a0ff-1ea2f5daf769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd17cc6-030e-4c7b-a5d5-d670d816ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd17cc6-030e-4c7b-a5d5-d670d816ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-806193562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abfb8ce-da1e-4b4c-aee6-d34168c4df5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:51Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4413abdc-d4f1-449c-a59d-962da252cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4413abdc-d4f1-449c-a59d-962da252cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fefab-b434-42e6-8039-237eb93f24c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fefab-b434-42e6-8039-237eb93f24c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abfb8ce-da1e-4b4c-aee6-d34168c4df5d', 'volume_name': 'volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba6843b-7a99-4543-9b86-938f46038715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba6843b-7a99-4543-9b86-938f46038715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82166425-f764-4fcf-909a-c123f71cd256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:50 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume 5abfb8ce-da1e-4b4c-aee6-d34168c4df5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d', 'volume_size': 1} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc 1073741824" returned: 0 in 0.578s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:50 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc Apr 22 09:03:50 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (09ed0364-9025-4453-9ced-cd773aa77cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cb7bdc-cdc0-47b1-98c4-9391cf06c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cb7bdc-cdc0-47b1-98c4-9391cf06c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319528268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf9438f-0316-49bf-8226-cbe6908ff8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:51Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23439be2-85cc-4a7f-b6c6-e598aaa16db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23439be2-85cc-4a7f-b6c6-e598aaa16db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef92a3c9-200b-4cf5-807f-e6f397751032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef92a3c9-200b-4cf5-807f-e6f397751032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf9438f-0316-49bf-8226-cbe6908ff8b2', 'volume_name': 'volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39e5e7-b81f-476f-bf35-81083552ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39e5e7-b81f-476f-bf35-81083552ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffd6346-b15b-4347-ac6d-5970081c509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:51 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume ecf9438f-0316-49bf-8226-cbe6908ff8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2', 'volume_size': 1} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:51 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc" returned: 0 in 0.422s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926277006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bdc44ae-8841-4b1c-9882-0e4433c8dd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:50Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Creating volume 1bdc44ae-8841-4b1c-9882-0e4433c8dd43 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:51 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9765d80f-b8ba-4c90-bb51-6b5963c5674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:51 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 1073741824 Apr 22 09:03:51 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185335fb-9010-4a3c-b8c1-da06178449ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:51 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc (1aaed879-e6f5-47c1-aef4-f54a3c1128fc): created successfully Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185335fb-9010-4a3c-b8c1-da06178449ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (17f4d477-30fb-4891-b34e-78f8a902d20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:51 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-77524a2d-1b2b-4d44-9245-e299998b0eac tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created volume successfully. Apr 22 09:03:51 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 1073741824" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:51 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 Apr 22 09:03:51 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:52 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18678148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6532ffe-58af-4b68-bc74-2cbc09d3f087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:51Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Creating volume f6532ffe-58af-4b68-bc74-2cbc09d3f087 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:52 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a3d80-eedd-466a-a8ba-f92ff552c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9b5821-fdd1-40c0-ae12-acac03ce18bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:52 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 1073741824 Apr 22 09:03:52 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:52 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 (1bdc44ae-8841-4b1c-9882-0e4433c8dd43): created successfully Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9b5821-fdd1-40c0-ae12-acac03ce18bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (fadd326c-2239-4aaf-b7e6-76b30de07824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:52 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-aee5f648-f519-4288-8bf1-d77b6dca6ab4 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created volume successfully. Apr 22 09:03:52 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 1073741824" returned: 0 in 0.469s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:52 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 Apr 22 09:03:52 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:53 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087" returned: 0 in 0.415s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.253s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-806193562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abfb8ce-da1e-4b4c-aee6-d34168c4df5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:51Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Creating volume 5abfb8ce-da1e-4b4c-aee6-d34168c4df5d {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:53 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9138fbb6-beaf-48c6-ae9a-a0fcdb541b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a04c9a-fa71-43e6-aec0-c48c48026b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:53 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d 1073741824 Apr 22 09:03:53 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:53 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 (f6532ffe-58af-4b68-bc74-2cbc09d3f087): created successfully Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a04c9a-fa71-43e6-aec0-c48c48026b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (30830d33-533f-49b7-9ff2-396e47f7ed42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2c351a2c-4d0c-4af6-b0ac-2b590405e087 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created volume successfully. Apr 22 09:03:53 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d 1073741824" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:53 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d Apr 22 09:03:53 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:53 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d" returned: 0 in 0.387s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.896s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319528268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf9438f-0316-49bf-8226-cbe6908ff8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53fd97dd783478aa83b796496dd8cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:03:51Z,use_quota=True,user_id='2b8a1f08cd6f44baba03ccad4bd4f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Creating volume ecf9438f-0316-49bf-8226-cbe6908ff8b2 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:03:53 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:03:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82166425-f764-4fcf-909a-c123f71cd256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fd676d-7e00-45ec-8ad8-8ef48f44cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:54 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 1073741824 Apr 22 09:03:54 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:54 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d (5abfb8ce-da1e-4b4c-aee6-d34168c4df5d): created successfully Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fd676d-7e00-45ec-8ad8-8ef48f44cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (ab722b68-4409-451d-a0ff-1ea2f5daf769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a479fd0c-1778-468d-8ecc-46e230999475 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created volume successfully. Apr 22 09:03:54 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 1073741824" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:54 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 Apr 22 09:03:54 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:54 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2" returned: 0 in 0.385s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffd6346-b15b-4347-ac6d-5970081c509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f9fec6-af77-4cf5-b626-244ad40eaf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:03:54 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Volume volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 (ecf9438f-0316-49bf-8226-cbe6908ff8b2): created successfully Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f9fec6-af77-4cf5-b626-244ad40eaf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:03:54 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Flow 'volume_create_manager' (09ed0364-9025-4453-9ced-cd773aa77cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:03:54 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-822e51b0-e3f3-43df-b13d-2ed868773e72 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created volume successfully. Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-ecf9438f-0316-49bf-8226-cbe6908ff8b2-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-ecf9438f-0316-49bf-8226-cbe6908ff8b2-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-quobyte-ecf9438f-0316-49bf-8226-cbe6908ff8b2" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-ecf9438f-0316-49bf-8226-cbe6908ff8b2" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[50170ddd-5e60-4ec1-8b97-bc0e63b7df81]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:55 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 Apr 22 09:03:55 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:55 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2" returned: 0 in 0.439s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:55 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2 Apr 22 09:03:55 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:56 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-ecf9438f-0316-49bf-8226-cbe6908ff8b2" returned: 0 in 0.388s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-ecf9438f-0316-49bf-8226-cbe6908ff8b2" released by "delete_volume" :: held 0.851s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created reservations ['518c0a44-c59a-4966-9d38-bed747369b4b', '255aad8e-3322-45b9-912b-b955e3582c64', '8911d72c-2247-456b-8ba6-fb49d940b9c9', '56ad41ac-b11e-45e2-8f89-37e5e7b00fda'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:56 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:56 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-quobyte-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[769c5e24-fe02-4ee2-aa15-fb9a79f79e01]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:56 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d Apr 22 09:03:56 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:56 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.410s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:56 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Deleted volume successfully. Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1faad858-f8b5-4edb-b5ac-f06ff55a3474 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-ecf9438f-0316-49bf-8226-cbe6908ff8b2-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:56 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d" returned: 0 in 0.449s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:57 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d Apr 22 09:03:57 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:57 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d" returned: 0 in 0.388s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d" released by "delete_volume" :: held 0.857s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created reservations ['7d65ceb3-7757-4399-94c5-5eba3662b526', '5678d301-0327-47bb-90f9-7e833f02c1c6', '6b75a4df-511d-4ad1-a987-ff382c66e819', '815c7a9e-d50c-432a-98c8-ec95718c595e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:57 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:57 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-f6532ffe-58af-4b68-bc74-2cbc09d3f087-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-f6532ffe-58af-4b68-bc74-2cbc09d3f087-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-quobyte-f6532ffe-58af-4b68-bc74-2cbc09d3f087" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-f6532ffe-58af-4b68-bc74-2cbc09d3f087" acquired by "delete_volume" :: waited 0.014s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ac25c-86a0-49a9-be06-2a8fe708f29d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:57 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 Apr 22 09:03:57 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:57 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.396s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:57 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Deleted volume successfully. Apr 22 09:03:57 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9d1227e8-557a-4699-aca6-fdb9d6d030f8 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-5abfb8ce-da1e-4b4c-aee6-d34168c4df5d-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:58 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087" returned: 0 in 0.443s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:58 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087 Apr 22 09:03:58 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:58 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f6532ffe-58af-4b68-bc74-2cbc09d3f087" returned: 0 in 0.378s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-f6532ffe-58af-4b68-bc74-2cbc09d3f087" released by "delete_volume" :: held 0.840s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created reservations ['42ad1074-0c19-40e6-ab7b-fa0ee8915fef', '92315926-cb97-4510-bba9-c96a5796e69f', '29da2674-0c6a-486c-ac3b-55bd16083c22', 'bf4ad346-23f4-4194-a68f-b189f0236d65'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:58 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:58 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-1bdc44ae-8841-4b1c-9882-0e4433c8dd43-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-1bdc44ae-8841-4b1c-9882-0e4433c8dd43-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-quobyte-1bdc44ae-8841-4b1c-9882-0e4433c8dd43" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-1bdc44ae-8841-4b1c-9882-0e4433c8dd43" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb5426-9a3c-4736-b8b0-8e1092a06d8f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:58 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 Apr 22 09:03:58 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:58 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.412s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:03:58 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Deleted volume successfully. Apr 22 09:03:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-41818756-abeb-4235-8a43-9c4e0e8dbb25 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-f6532ffe-58af-4b68-bc74-2cbc09d3f087-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:59 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:59 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43 Apr 22 09:03:59 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:59 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1bdc44ae-8841-4b1c-9882-0e4433c8dd43" returned: 0 in 0.381s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-1bdc44ae-8841-4b1c-9882-0e4433c8dd43" released by "delete_volume" :: held 0.857s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created reservations ['c290638d-49fd-4479-b8a8-56247ac055b5', 'cb6bf141-b218-4e1c-987b-931e79900f26', '4f33b5ae-24ce-4eec-88c8-0960f253330f', 'f576e076-a42e-4858-a46b-cc02e4fd1f1a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:59 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:03:59 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-1aaed879-e6f5-47c1-aef4-f54a3c1128fc-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-1aaed879-e6f5-47c1-aef4-f54a3c1128fc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-quobyte-1aaed879-e6f5-47c1-aef4-f54a3c1128fc" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-1aaed879-e6f5-47c1-aef4-f54a3c1128fc" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60a8e1-2f3e-4926-90f3-1d722f8f5de1]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:03:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:03:59 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc Apr 22 09:03:59 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:00 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.409s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:00 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Deleted volume successfully. Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fee0de86-e87b-4783-b523-658d89039e61 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-1bdc44ae-8841-4b1c-9882-0e4433c8dd43-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:00 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc" returned: 0 in 0.458s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:00 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc Apr 22 09:04:00 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:00 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-1aaed879-e6f5-47c1-aef4-f54a3c1128fc" returned: 0 in 0.382s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-1aaed879-e6f5-47c1-aef4-f54a3c1128fc" released by "delete_volume" :: held 0.865s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created reservations ['6d9367cc-6a5e-4195-a798-1c26217dace4', 'd59f9d61-87ce-43f9-a8bb-786cf9ea3ca6', 'ed1fc5fd-355c-4153-9345-3dce07a6b50d', 'b105c95f-5e09-4ecd-8505-2ab795e0b462'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:00 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:00 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-f65cafdb-d83e-40d6-a38b-93255cfd9135-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-f65cafdb-d83e-40d6-a38b-93255cfd9135-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "cinder-quobyte-f65cafdb-d83e-40d6-a38b-93255cfd9135" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-f65cafdb-d83e-40d6-a38b-93255cfd9135" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae995a12-0d97-470f-b20e-d7f3af299599]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:01 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 Apr 22 09:04:01 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:01 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.394s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:01 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Deleted volume successfully. Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7996dda4-5855-4c4b-813a-e65e74af081d tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-1aaed879-e6f5-47c1-aef4-f54a3c1128fc-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:01 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:01 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135 Apr 22 09:04:01 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:01 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f65cafdb-d83e-40d6-a38b-93255cfd9135" returned: 0 in 0.380s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-quobyte-f65cafdb-d83e-40d6-a38b-93255cfd9135" released by "delete_volume" :: held 0.856s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Created reservations ['7a3abb39-cd77-4e31-a7f2-3852e1addb9e', '81dc5674-9ac9-4b27-bb2a-133e3473eee3', '45be7a28-5254-4bd8-a772-0e4bffdebded', '4efc30bb-6f56-4bd7-8716-2f35a23aebb1'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:01 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:01 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:02 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:02 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:02 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Deleted volume successfully. Apr 22 09:04:02 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e471e442-74ea-45d5-85e3-f5023800d7d5 tempest-CreateVolumesFromSourceVolumeTest-758764566 None] Lock "cinder-f65cafdb-d83e-40d6-a38b-93255cfd9135-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:11 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=131,cinder:INSERT=32,cinder:SELECT=89,cinder:DELETE=6 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=68,cinder:UPDATE=113,cinder:DELETE=13,cinder:INSERT=27 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:12 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:12 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:13 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.387s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:13 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Flow 'volume_create_manager' (17b7f419-b280-4d25-80cb-4e3d620403bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994c543d-1117-4277-96fe-d720e6f7aeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994c543d-1117-4277-96fe-d720e6f7aeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-479648944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e497145e-68df-40bb-9868-61f0bf37fbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b1c2818c3475eb1f667f113edd25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:17Z,use_quota=True,user_id='bc8937a2424a4e6ab0f59af9c7358e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffec67c2-cc42-4875-bff2-5d11ef707567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffec67c2-cc42-4875-bff2-5d11ef707567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed8b73a-f9e2-486d-a611-c1420773aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed8b73a-f9e2-486d-a611-c1420773aefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e497145e-68df-40bb-9868-61f0bf37fbeb', 'volume_name': 'volume-e497145e-68df-40bb-9868-61f0bf37fbeb', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c61aa0-5441-4000-acde-d4cb33e8aa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c61aa0-5441-4000-acde-d4cb33e8aa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96bf08f-07e3-444b-866f-527afeb9daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:16 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Volume e497145e-68df-40bb-9868-61f0bf37fbeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e497145e-68df-40bb-9868-61f0bf37fbeb', 'volume_size': 1} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-479648944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e497145e-68df-40bb-9868-61f0bf37fbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b1c2818c3475eb1f667f113edd25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:17Z,use_quota=True,user_id='bc8937a2424a4e6ab0f59af9c7358e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Creating volume e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:16 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:16 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb 1073741824 Apr 22 09:04:16 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:17 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb 1073741824" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:17 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:17 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:17 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.387s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96bf08f-07e3-444b-866f-527afeb9daaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e497145e-68df-40bb-9868-61f0bf37fbeb', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a65aa7c-08a5-4b70-83a5-182a5d3ad187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:17 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Volume volume-e497145e-68df-40bb-9868-61f0bf37fbeb (e497145e-68df-40bb-9868-61f0bf37fbeb): created successfully Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a65aa7c-08a5-4b70-83a5-182a5d3ad187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Flow 'volume_create_manager' (17b7f419-b280-4d25-80cb-4e3d620403bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:17 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9226ac71-ec89-49dd-aacb-f10f9123329e tempest-SnapshotDependencyTests-441004430 None] Created volume successfully. Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Creating offline snapshot 4f4b7283-ddab-4c85-8442-99e271f59a6c of volume e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0db736-467c-46a6-807a-98e3ad64ecc9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:17 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:17 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:18 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:18 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c 1G Apr 22 09:04:18 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:18 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c 1G" returned: 0 in 0.433s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e497145e-68df-40bb-9868-61f0bf37fbeb -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:18 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e497145e-68df-40bb-9868-61f0bf37fbeb -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c Apr 22 09:04:18 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:19 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e497145e-68df-40bb-9868-61f0bf37fbeb -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:19 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c is being set with open permissions: ugo+rw Apr 22 09:04:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:19 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c Apr 22 09:04:19 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:19 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c" returned: 0 in 0.378s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:19 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info Apr 22 09:04:19 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:19 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:19 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info is being set with open permissions: ugo+rw Apr 22 09:04:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:19 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info Apr 22 09:04:19 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:20 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.info" returned: 0 in 0.378s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:20 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-626718f8-e1f4-4e8f-a74a-7e6c90d4ca33 tempest-SnapshotDependencyTests-441004430 None] Create snapshot completed successfully Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Flow 'volume_create_manager' (1c09d97d-4e55-4920-96ce-fd1e239b8ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f393ba1-54b4-40ca-9883-d0d43f7190a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f393ba1-54b4-40ca-9883-d0d43f7190a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29f78c8-3c96-4169-a0d0-03377b5aabd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b1c2818c3475eb1f667f113edd25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f4b7283-ddab-4c85-8442-99e271f59a6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:21Z,use_quota=True,user_id='bc8937a2424a4e6ab0f59af9c7358e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3ad33f-1a14-475b-bcc4-7c9c134efbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3ad33f-1a14-475b-bcc4-7c9c134efbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b888a533-d3b5-44c5-9ea9-af7cfd616fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b888a533-d3b5-44c5-9ea9-af7cfd616fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e29f78c8-3c96-4169-a0d0-03377b5aabd9', 'volume_name': 'volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9', 'volume_size': 1, 'snapshot_id': '4f4b7283-ddab-4c85-8442-99e271f59a6c'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9ae473-9274-4372-9579-41d7b936f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9ae473-9274-4372-9579-41d7b936f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de6804f-24a5-4926-8089-f6e18df3b819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:21 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Volume e29f78c8-3c96-4169-a0d0-03377b5aabd9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9', 'volume_size': 1, 'snapshot_id': '4f4b7283-ddab-4c85-8442-99e271f59a6c'} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-quobyte-4f4b7283-ddab-4c85-8442-99e271f59a6c-e29f78c8-3c96-4169-a0d0-03377b5aabd9" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-4f4b7283-ddab-4c85-8442-99e271f59a6c-e29f78c8-3c96-4169-a0d0-03377b5aabd9" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Creating volume e29f78c8-3c96-4169-a0d0-03377b5aabd9 from snapshot 4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-quobyte-e29f78c8-3c96-4169-a0d0-03377b5aabd9" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e29f78c8-3c96-4169-a0d0-03377b5aabd9" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] snapshot: 4f4b7283-ddab-4c85-8442-99e271f59a6c, volume: e29f78c8-3c96-4169-a0d0-03377b5aabd9, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a37e4-78f6-45a4-b487-5c06e05d035c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:21 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c Apr 22 09:04:21 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:21 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c" returned: 0 in 0.475s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e497145e-68df-40bb-9868-61f0bf37fbeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecbc000-c91e-4847-8400-78545dbebb2c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:21 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:21 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:22 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:22 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:04:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:22 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 Apr 22 09:04:22 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:24 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9" returned: 0 in 1.871s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba17393-7c7b-4785-ae1a-9d38e46bc2df]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:24 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:24 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:24 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.586s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:24 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:04:24 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Converted 1024.00 MB image at 546.99 MB/s Apr 22 09:04:24 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 is being set with open permissions: ugo+rw Apr 22 09:04:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:24 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 Apr 22 09:04:24 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:25 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e29f78c8-3c96-4169-a0d0-03377b5aabd9" released by "_copy_volume_from_snapshot" :: held 3.839s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-4f4b7283-ddab-4c85-8442-99e271f59a6c-e29f78c8-3c96-4169-a0d0-03377b5aabd9" released by "_create_volume_from_snapshot" :: held 3.852s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.862s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de6804f-24a5-4926-8089-f6e18df3b819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9', 'volume_size': 1, 'snapshot_id': '4f4b7283-ddab-4c85-8442-99e271f59a6c'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95680d92-d4e8-4933-96bc-0457b44e78f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:25 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Volume volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 (e29f78c8-3c96-4169-a0d0-03377b5aabd9): created successfully Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95680d92-d4e8-4933-96bc-0457b44e78f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Flow 'volume_create_manager' (1c09d97d-4e55-4920-96ce-fd1e239b8ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:25 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-632fa877-d493-48f6-be4a-95175ddb8f4f tempest-SnapshotDependencyTests-441004430 None] Created volume successfully. Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-4f4b7283-ddab-4c85-8442-99e271f59a6c-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-4f4b7283-ddab-4c85-8442-99e271f59a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-quobyte-e497145e-68df-40bb-9868-61f0bf37fbeb" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e497145e-68df-40bb-9868-61f0bf37fbeb" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-quobyte-4f4b7283-ddab-4c85-8442-99e271f59a6c" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-4f4b7283-ddab-4c85-8442-99e271f59a6c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Deleting offline snapshot 4f4b7283-ddab-4c85-8442-99e271f59a6c of volume e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] snapshot_file for this snap is: volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2237f85-fb1d-4340-a5a3-9966aeeacdf0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:25 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c Apr 22 09:04:25 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:26 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e497145e-68df-40bb-9868-61f0bf37fbeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef7a662-daf7-49ce-865e-c37c921657ac]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:26 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:26 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:26 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:26 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c Apr 22 09:04:26 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:26 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c" returned: 0 in 0.448s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:27 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c Apr 22 09:04:27 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:27 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb.4f4b7283-ddab-4c85-8442-99e271f59a6c" returned: 0 in 0.389s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-4f4b7283-ddab-4c85-8442-99e271f59a6c" released by "_delete_snapshot" :: held 1.826s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e497145e-68df-40bb-9868-61f0bf37fbeb" released by "delete_snapshot" :: held 1.837s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Created reservations ['f03da3ba-9a9d-415b-95d1-fa15e7f79c65', '1dcb79c7-ef2e-4de0-a4f5-07953b8a6191', 'c914a9a4-755f-4137-8889-f8b99daf8d15', '69e80b27-2948-41da-939b-39e54bb64eb0'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:27 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Delete snapshot completed successfully. Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4a29079c-90ce-4525-aab3-2151c5d8566b tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-4f4b7283-ddab-4c85-8442-99e271f59a6c-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-e497145e-68df-40bb-9868-61f0bf37fbeb-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-e497145e-68df-40bb-9868-61f0bf37fbeb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-quobyte-e497145e-68df-40bb-9868-61f0bf37fbeb" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e497145e-68df-40bb-9868-61f0bf37fbeb" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[81869bf9-8861-438a-b5c8-185bf2c0611f]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:27 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:27 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:28 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:28 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb Apr 22 09:04:28 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:28 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e497145e-68df-40bb-9868-61f0bf37fbeb" returned: 0 in 0.389s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e497145e-68df-40bb-9868-61f0bf37fbeb" released by "delete_volume" :: held 0.862s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Created reservations ['049256c7-78ea-4bdf-a1fc-8b900f9578a4', '4a80fa02-4c4f-4319-9058-544e4c7c81b7', 'bd8a2ee3-243b-40d2-92fa-4bf25092835f', '46c873ad-ac0e-4d7f-a420-2ddee723f5fe'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:28 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:28 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-e29f78c8-3c96-4169-a0d0-03377b5aabd9-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-e29f78c8-3c96-4169-a0d0-03377b5aabd9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "cinder-quobyte-e29f78c8-3c96-4169-a0d0-03377b5aabd9" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e29f78c8-3c96-4169-a0d0-03377b5aabd9" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e078a14-ab67-4ed6-af2a-100a3ff41be4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:28 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 Apr 22 09:04:28 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:29 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.412s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:29 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Deleted volume successfully. Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ea822a0-2798-4708-9c67-08c471ed5b03 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-e497145e-68df-40bb-9868-61f0bf37fbeb-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:29 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:29 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9 Apr 22 09:04:29 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:29 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e29f78c8-3c96-4169-a0d0-03377b5aabd9" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-quobyte-e29f78c8-3c96-4169-a0d0-03377b5aabd9" released by "delete_volume" :: held 0.876s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Created reservations ['2a860db7-9db2-4e5c-92d3-129e225fd829', 'a40d5168-e05e-479c-b00c-79654c33e9dc', '5dd98d2b-5ffd-47e6-a0b0-ecbdff059085', '08672f39-e635-43de-be0b-7c37d30e25e6'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:29 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:29 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:30 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:30 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:30 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Deleted volume successfully. Apr 22 09:04:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-e7dc4700-98b1-4a36-ac7b-f09d46e6d599 tempest-SnapshotDependencyTests-441004430 None] Lock "cinder-e29f78c8-3c96-4169-a0d0-03377b5aabd9-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:39 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:04:40 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=23,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=8 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (1f09f888-92c5-4c8f-933f-49fc9ba3e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7ccb4-92e2-4587-ac54-5c91be4544f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7ccb4-92e2-4587-ac54-5c91be4544f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1970049412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f62e9f-b53c-4cec-9bad-4aba2c904e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb5f9d44a6f435a9f9af4c97a4d7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:41Z,use_quota=True,user_id='f39ffb0a4aba4f81a7eab13ceb101d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec262982-beb7-4bb0-ba7f-fdfbcef76ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec262982-beb7-4bb0-ba7f-fdfbcef76ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692aa745-fbbc-41bd-8c8f-e86456bb832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692aa745-fbbc-41bd-8c8f-e86456bb832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f62e9f-b53c-4cec-9bad-4aba2c904e64', 'volume_name': 'volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab15117e-019c-46df-b8e4-be1027006a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab15117e-019c-46df-b8e4-be1027006a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d98538-7398-4e04-b999-095fc1860ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Volume b8f62e9f-b53c-4cec-9bad-4aba2c904e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64', 'volume_size': 1} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1970049412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f62e9f-b53c-4cec-9bad-4aba2c904e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb5f9d44a6f435a9f9af4c97a4d7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:41Z,use_quota=True,user_id='f39ffb0a4aba4f81a7eab13ceb101d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Creating volume b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:41 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:41 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 1073741824 Apr 22 09:04:41 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (53f128b9-12e4-44c4-bdb3-ac621a1e09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b4befe-09b2-4758-9d52-8f034e392588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b4befe-09b2-4758-9d52-8f034e392588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153045241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e70f05-1546-467e-84f2-2970427a92a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:41Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a9423e-d8e9-4b31-abe2-308bf6b3dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a9423e-d8e9-4b31-abe2-308bf6b3dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabd5c9c-49ec-40e6-b779-e73d29a7627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabd5c9c-49ec-40e6-b779-e73d29a7627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e70f05-1546-467e-84f2-2970427a92a9', 'volume_name': 'volume-a6e70f05-1546-467e-84f2-2970427a92a9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc50eb74-9639-46da-8e3d-a10abf0882b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc50eb74-9639-46da-8e3d-a10abf0882b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626b0b4a-16ea-4d2d-9405-6bffc4585af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume a6e70f05-1546-467e-84f2-2970427a92a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e70f05-1546-467e-84f2-2970427a92a9', 'volume_size': 1} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (f1c5be25-e581-4a66-abbf-1ff280fd2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0031be-0a20-4676-a673-4aca116a325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0031be-0a20-4676-a673-4aca116a325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354366715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe93aa43-a6b6-4f70-96a8-8712da8365b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f69d51a-82f2-490a-ae1b-6b51b38f6744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f69d51a-82f2-490a-ae1b-6b51b38f6744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f55990-b011-4f36-9346-38130751d0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f55990-b011-4f36-9346-38130751d0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe93aa43-a6b6-4f70-96a8-8712da8365b7', 'volume_name': 'volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61602846-dc16-487c-b687-8ab3c9e71e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61602846-dc16-487c-b687-8ab3c9e71e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb0ef9f-3ae9-43a9-81fb-af91bf6132cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Volume fe93aa43-a6b6-4f70-96a8-8712da8365b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7', 'volume_size': 1} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (07d14356-7306-4d18-b600-acc65b65c5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519d539f-6a69-4d09-9d13-6b29be5b4e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519d539f-6a69-4d09-9d13-6b29be5b4e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050092294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3c96df-8280-472b-9977-fd08ba1fbcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c18f062-0558-4f5c-9aef-9682b50a7d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c18f062-0558-4f5c-9aef-9682b50a7d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e5a3f-dca7-450f-9bc3-dcca99fad8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e5a3f-dca7-450f-9bc3-dcca99fad8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3c96df-8280-472b-9977-fd08ba1fbcbc', 'volume_name': 'volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2249ce6a-4aaa-4546-821c-9a8c8fbe427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2249ce6a-4aaa-4546-821c-9a8c8fbe427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f907ff44-81f3-4012-9638-0f406c382706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:41 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Volume cd3c96df-8280-472b-9977-fd08ba1fbcbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc', 'volume_size': 1} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:41 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (2e7b825d-8bbe-4605-bda6-e56b36ade35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:42 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf26e6af-557a-4247-8140-9bc315b512b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf26e6af-557a-4247-8140-9bc315b512b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64136383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f2bbdf-17ad-4608-925e-538ddebdb623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e110f-dbe9-48e5-8e62-0e4e78b654cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e110f-dbe9-48e5-8e62-0e4e78b654cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4934d536-e5ee-4447-b886-a1e495886587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4934d536-e5ee-4447-b886-a1e495886587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f2bbdf-17ad-4608-925e-538ddebdb623', 'volume_name': 'volume-c6f2bbdf-17ad-4608-925e-538ddebdb623', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b28af8e-5f39-419a-a38b-f60c4811e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b28af8e-5f39-419a-a38b-f60c4811e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792d38ed-2fd4-4df3-a80e-8e3646a85bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Volume c6f2bbdf-17ad-4608-925e-538ddebdb623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f2bbdf-17ad-4608-925e-538ddebdb623', 'volume_size': 1} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 1073741824" returned: 0 in 0.681s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:42 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:04:42 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (1766dfcd-c019-4f3e-bf3f-6f79438482cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e8cf3e-faa5-4ee4-af9c-7fa140f655c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e8cf3e-faa5-4ee4-af9c-7fa140f655c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059644739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092007da-7771-4f8b-a3ec-32ce6299addf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcefa8bf-e7c4-4af7-a1f6-c1beb1949671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcefa8bf-e7c4-4af7-a1f6-c1beb1949671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e8cd96-fb11-4745-a0be-7ea9985e0112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e8cd96-fb11-4745-a0be-7ea9985e0112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092007da-7771-4f8b-a3ec-32ce6299addf', 'volume_name': 'volume-092007da-7771-4f8b-a3ec-32ce6299addf', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d602696-485d-4330-96f8-aba3506be404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d602696-485d-4330-96f8-aba3506be404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc7231e-b419-42ec-8283-c6388359703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Volume 092007da-7771-4f8b-a3ec-32ce6299addf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092007da-7771-4f8b-a3ec-32ce6299addf', 'volume_size': 1} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (836f9aec-657a-459b-826a-0f76736ce551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8d48fb-f43c-44e0-aa72-174ddc139b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8d48fb-f43c-44e0-aa72-174ddc139b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515531618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb195659-1b17-4cb0-9c94-29b107367643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6289b764-6c37-440f-9aa2-19d2b6fea8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6289b764-6c37-440f-9aa2-19d2b6fea8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63888c4-1d56-476c-a9c7-e21121ef376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63888c4-1d56-476c-a9c7-e21121ef376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb195659-1b17-4cb0-9c94-29b107367643', 'volume_name': 'volume-bb195659-1b17-4cb0-9c94-29b107367643', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d96d92-0bed-49ce-92cd-1cda39778c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d96d92-0bed-49ce-92cd-1cda39778c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b2614-d8ce-4a3b-b968-0f28a89ab63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Volume bb195659-1b17-4cb0-9c94-29b107367643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb195659-1b17-4cb0-9c94-29b107367643', 'volume_size': 1} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:42 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.607s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153045241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e70f05-1546-467e-84f2-2970427a92a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:41Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating volume a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:42 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d98538-7398-4e04-b999-095fc1860ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c1c47e-68ee-4d4a-9c83-a81c5dd9e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:42 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 1073741824 Apr 22 09:04:42 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:42 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Volume volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 (b8f62e9f-b53c-4cec-9bad-4aba2c904e64): created successfully Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c1c47e-68ee-4d4a-9c83-a81c5dd9e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:42 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (1f09f888-92c5-4c8f-933f-49fc9ba3e568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:42 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-cc080c2e-004b-4cad-b69b-383990b219b6 tempest-VolumeDependencyTests-990782098 None] Created volume successfully. Apr 22 09:04:43 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 1073741824" returned: 0 in 0.529s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:43 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 Apr 22 09:04:43 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:43 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9" returned: 0 in 0.469s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.072s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354366715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe93aa43-a6b6-4f70-96a8-8712da8365b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Creating volume fe93aa43-a6b6-4f70-96a8-8712da8365b7 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:43 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626b0b4a-16ea-4d2d-9405-6bffc4585af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e70f05-1546-467e-84f2-2970427a92a9', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:43 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 1073741824 Apr 22 09:04:43 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dc1cd8-77a2-4ade-8a75-f12569149458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:43 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume volume-a6e70f05-1546-467e-84f2-2970427a92a9 (a6e70f05-1546-467e-84f2-2970427a92a9): created successfully Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dc1cd8-77a2-4ade-8a75-f12569149458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:43 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (53f128b9-12e4-44c4-bdb3-ac621a1e09a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:43 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-30ab9c65-cf00-4ab4-85a6-881b628e58e1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created volume successfully. Apr 22 09:04:44 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 1073741824" returned: 0 in 0.510s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:44 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 Apr 22 09:04:44 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:44 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7" returned: 0 in 0.523s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.873s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050092294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3c96df-8280-472b-9977-fd08ba1fbcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Creating volume cd3c96df-8280-472b-9977-fd08ba1fbcbc {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:44 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb0ef9f-3ae9-43a9-81fb-af91bf6132cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b29ecc2-f424-4f32-9564-be4698510414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:44 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc 1073741824 Apr 22 09:04:44 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:44 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Volume volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 (fe93aa43-a6b6-4f70-96a8-8712da8365b7): created successfully Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b29ecc2-f424-4f32-9564-be4698510414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:44 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (f1c5be25-e581-4a66-abbf-1ff280fd2122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:44 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-804b83d9-cebb-43d9-9598-2142f58691f2 tempest-CreateVolumesFromImageTest-152059936 None] Created volume successfully. Apr 22 09:04:45 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc 1073741824" returned: 0 in 0.483s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:45 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc Apr 22 09:04:45 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:45 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc" returned: 0 in 0.409s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.649s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64136383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f2bbdf-17ad-4608-925e-538ddebdb623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Creating volume c6f2bbdf-17ad-4608-925e-538ddebdb623 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:45 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f907ff44-81f3-4012-9638-0f406c382706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0489826-3d4c-47fe-86b1-c178979ebaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:45 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 1073741824 Apr 22 09:04:45 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:45 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Volume volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc (cd3c96df-8280-472b-9977-fd08ba1fbcbc): created successfully Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0489826-3d4c-47fe-86b1-c178979ebaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:45 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (07d14356-7306-4d18-b600-acc65b65c5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:45 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-924e4626-985a-4df8-accf-72bf402eb53f tempest-CreateVolumesFromImageTest-152059936 None] Created volume successfully. Apr 22 09:04:46 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 1073741824" returned: 0 in 0.553s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:46 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 Apr 22 09:04:46 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:46 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.475s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059644739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092007da-7771-4f8b-a3ec-32ce6299addf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Creating volume 092007da-7771-4f8b-a3ec-32ce6299addf {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:46 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792d38ed-2fd4-4df3-a80e-8e3646a85bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f2bbdf-17ad-4608-925e-538ddebdb623', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432783be-6f12-40f3-9ed3-6fc754e70d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:46 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Volume volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 (c6f2bbdf-17ad-4608-925e-538ddebdb623): created successfully Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432783be-6f12-40f3-9ed3-6fc754e70d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:46 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf 1073741824 Apr 22 09:04:46 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:46 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (2e7b825d-8bbe-4605-bda6-e56b36ade35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:46 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-03039b4f-e40c-4157-96a7-00b684c46115 tempest-CreateVolumesFromImageTest-152059936 None] Created volume successfully. Apr 22 09:04:47 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf 1073741824" returned: 0 in 0.515s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:47 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf Apr 22 09:04:47 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:47 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf" returned: 0 in 0.421s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.153s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515531618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb195659-1b17-4cb0-9c94-29b107367643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f84ddbabba469f97f6c969d780d1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:42Z,use_quota=True,user_id='d1d0387cffeb4074b27db536e64319cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Creating volume bb195659-1b17-4cb0-9c94-29b107367643 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:47 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:47 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 1073741824 Apr 22 09:04:47 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc7231e-b419-42ec-8283-c6388359703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092007da-7771-4f8b-a3ec-32ce6299addf', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d879bfd3-639a-4cc1-87ee-cc558178b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:47 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Volume volume-092007da-7771-4f8b-a3ec-32ce6299addf (092007da-7771-4f8b-a3ec-32ce6299addf): created successfully Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d879bfd3-639a-4cc1-87ee-cc558178b603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:47 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (1766dfcd-c019-4f3e-bf3f-6f79438482cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:47 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ab011709-0f11-4c01-9390-1fa2a0614772 tempest-CreateVolumesFromImageTest-152059936 None] Created volume successfully. Apr 22 09:04:48 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 1073741824" returned: 0 in 0.621s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:48 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 Apr 22 09:04:48 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:48 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.264s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b2614-d8ce-4a3b-b968-0f28a89ab63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb195659-1b17-4cb0-9c94-29b107367643', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da406985-2a80-40eb-bf92-e540e6fc16f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Creating offline snapshot c30cb70a-38a7-43dd-91a0-17f674210dbf of volume b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:04:48 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Volume volume-bb195659-1b17-4cb0-9c94-29b107367643 (bb195659-1b17-4cb0-9c94-29b107367643): created successfully Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da406985-2a80-40eb-bf92-e540e6fc16f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Flow 'volume_create_manager' (836f9aec-657a-459b-826a-0f76736ce551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[90461310-9f48-4393-ad64-b8adca1d0b33]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:48 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:48 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-330f7a20-3ce5-4cb9-b825-ed313aeec35f tempest-CreateVolumesFromImageTest-152059936 None] Created volume successfully. Apr 22 09:04:48 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:04:48 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-bb195659-1b17-4cb0-9c94-29b107367643-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-bb195659-1b17-4cb0-9c94-29b107367643-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-quobyte-bb195659-1b17-4cb0-9c94-29b107367643" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-bb195659-1b17-4cb0-9c94-29b107367643" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f550b31d-a410-4c7d-ac56-0d5c531ddc0a]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:49 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 Apr 22 09:04:49 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:49 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.582s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:49 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf 1G Apr 22 09:04:49 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:49 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643" returned: 0 in 0.513s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:49 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:49 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643 Apr 22 09:04:49 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:50 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf 1G" returned: 0 in 0.546s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:50 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf Apr 22 09:04:50 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:50 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-bb195659-1b17-4cb0-9c94-29b107367643" returned: 0 in 0.493s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-bb195659-1b17-4cb0-9c94-29b107367643" released by "delete_volume" :: held 1.039s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Created reservations ['8d9c4e52-6deb-4843-9f29-88eebdbcdff8', '95d1fe5e-3dad-4e5e-9af5-162087feaae0', '24b810dc-151d-49a1-8358-b7a2d5b3c3ef', 'd5a53a30-96a4-48b9-83d9-7a52654f4e46'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:50 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:50 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:50 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf" returned: 0 in 0.475s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:50 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf is being set with open permissions: ugo+rw Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:50 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf Apr 22 09:04:50 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:50 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:50 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Deleted volume successfully. Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-29787503-02bf-448c-a695-a26cb068aa61 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-bb195659-1b17-4cb0-9c94-29b107367643-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:50 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:50 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:51 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info Apr 22 09:04:51 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-092007da-7771-4f8b-a3ec-32ce6299addf-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-092007da-7771-4f8b-a3ec-32ce6299addf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-quobyte-092007da-7771-4f8b-a3ec-32ce6299addf" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-092007da-7771-4f8b-a3ec-32ce6299addf" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf0c67-bfd0-4045-bf14-0e642e332af2]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:51 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:51 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info is being set with open permissions: ugo+rw Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:51 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf Apr 22 09:04:51 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:51 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info Apr 22 09:04:51 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:51 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:51 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.info" returned: 0 in 0.516s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.116s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.230s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:51 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf" returned: 0 in 0.595s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating offline snapshot 4555b43f-0ff8-4775-ae7a-c8e607da6fec of volume a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:04:52 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf Apr 22 09:04:52 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c83c38-9531-4395-b799-3e63b0ea920e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:52 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-3c907a9b-0a57-4944-9fec-da5eb48c5435 tempest-VolumeDependencyTests-990782098 None] Create snapshot completed successfully Apr 22 09:04:52 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 Apr 22 09:04:52 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:52 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-092007da-7771-4f8b-a3ec-32ce6299addf" returned: 0 in 0.468s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-092007da-7771-4f8b-a3ec-32ce6299addf" released by "delete_volume" :: held 1.094s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Created reservations ['2f3c88dc-cf8c-4c32-961e-5b54d32d20a3', '625a10d3-d9e9-4019-9440-756fabcfe0ec', '248db0d0-87f8-4f58-91ab-29d6ccd6bae0', '949a43f2-859a-4e30-8aa7-ea0d4005d4ff'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:52 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9" returned: 0 in 0.534s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:52 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:52 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:52 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:52 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec 1G Apr 22 09:04:52 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:53 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:53 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Deleted volume successfully. Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-2f672071-3051-4905-aa70-0cae349800ec tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-092007da-7771-4f8b-a3ec-32ce6299addf-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:53 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec 1G" returned: 0 in 0.605s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e70f05-1546-467e-84f2-2970427a92a9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:53 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e70f05-1546-467e-84f2-2970427a92a9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec Apr 22 09:04:53 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (bf4d24c0-c659-4a66-9525-de7c129b6b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cac51b3-be37-4948-95f8-56bf8f5fec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cac51b3-be37-4948-95f8-56bf8f5fec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1915295275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb5f9d44a6f435a9f9af4c97a4d7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c30cb70a-38a7-43dd-91a0-17f674210dbf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:53Z,use_quota=True,user_id='f39ffb0a4aba4f81a7eab13ceb101d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56db7f28-a145-4323-81f1-1c6b8c5a0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56db7f28-a145-4323-81f1-1c6b8c5a0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e884601-3d80-4b4a-a06f-9a5037c43e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e884601-3d80-4b4a-a06f-9a5037c43e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f', 'volume_name': 'volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f', 'volume_size': 1, 'snapshot_id': 'c30cb70a-38a7-43dd-91a0-17f674210dbf'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac1c842-24cc-4149-b8dc-f33ff6d78850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac1c842-24cc-4149-b8dc-f33ff6d78850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ba4421-a509-4cc0-9359-1730816caf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:53 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Volume c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f', 'volume_size': 1, 'snapshot_id': 'c30cb70a-38a7-43dd-91a0-17f674210dbf'} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-c6f2bbdf-17ad-4608-925e-538ddebdb623-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-c6f2bbdf-17ad-4608-925e-538ddebdb623-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-quobyte-c6f2bbdf-17ad-4608-925e-538ddebdb623" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-c6f2bbdf-17ad-4608-925e-538ddebdb623" acquired by "delete_volume" :: waited 0.018s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bcec9e-db97-4282-80da-5ab4399bbc15]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:53 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 Apr 22 09:04:53 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:53 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e70f05-1546-467e-84f2-2970427a92a9 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec" returned: 0 in 0.521s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:53 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec is being set with open permissions: ugo+rw Apr 22 09:04:53 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:53 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec Apr 22 09:04:53 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:54 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623" returned: 0 in 0.607s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:54 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec" returned: 0 in 0.503s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:54 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623 Apr 22 09:04:54 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:54 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info Apr 22 09:04:54 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:54 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info" returned: 0 in 0.428s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:54 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info is being set with open permissions: ugo+rw Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:54 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c6f2bbdf-17ad-4608-925e-538ddebdb623" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:54 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info Apr 22 09:04:54 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-c6f2bbdf-17ad-4608-925e-538ddebdb623" released by "delete_volume" :: held 1.130s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Created reservations ['486c42dc-cf44-4ca7-9382-13d0e2671d29', 'd41304e1-feba-435a-9122-f91f65b2e5e9', '2ff745e8-ed0e-4ee8-af45-fdba514ef022', '38791c34-c1c8-4951-9474-2b7c2f1f908e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:54 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:54 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:54 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:55 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.info" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.780s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-c30cb70a-38a7-43dd-91a0-17f674210dbf-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c30cb70a-38a7-43dd-91a0-17f674210dbf-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Creating volume c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f from snapshot c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-c9db060e-27a4-46e5-a89b-10a83f745b71 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Create snapshot completed successfully Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] snapshot: c30cb70a-38a7-43dd-91a0-17f674210dbf, volume: c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc0529d-2d5c-4596-ad4e-769ff96e5161]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:55 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.501s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:55 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Deleted volume successfully. Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-aa0d3324-fb6b-4dee-9f1b-04a4dd119a1b tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-c6f2bbdf-17ad-4608-925e-538ddebdb623-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:55 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf Apr 22 09:04:55 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-cd3c96df-8280-472b-9977-fd08ba1fbcbc-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-cd3c96df-8280-472b-9977-fd08ba1fbcbc-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-quobyte-cd3c96df-8280-472b-9977-fd08ba1fbcbc" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-cd3c96df-8280-472b-9977-fd08ba1fbcbc" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[345e95d5-6254-4149-9259-41c0ec9a14a3]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:55 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc Apr 22 09:04:55 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:55 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf" returned: 0 in 0.664s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aba399-8f23-4c0e-9572-bc1b144bfb70]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:55 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:55 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:04:55 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:56 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:56 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc Apr 22 09:04:56 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:56 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.547s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:56 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f Apr 22 09:04:56 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (707f458f-2e78-4d91-b1ff-6b8ad6547247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16e40c-9d69-4b3f-952c-9c6ccf3f3a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16e40c-9d69-4b3f-952c-9c6ccf3f3a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293645331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3202ee-cd33-4918-8d34-c34140cb0f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80f2214-14d5-487e-b5de-ebfd606ea523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80f2214-14d5-487e-b5de-ebfd606ea523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6741c1ea-985a-4dfe-9688-c3e74ae6113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6741c1ea-985a-4dfe-9688-c3e74ae6113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3202ee-cd33-4918-8d34-c34140cb0f1f', 'volume_name': 'volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e1bb26-f2b2-4869-b658-01f0183e9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e1bb26-f2b2-4869-b658-01f0183e9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbbca6b-45e8-4cc0-8309-e17db9d81c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume 9d3202ee-cd33-4918-8d34-c34140cb0f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f', 'volume_size': 1} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Flow 'volume_create_manager' (1a1160d5-68aa-4b52-8605-26e945254ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e04343-dedc-480e-87a6-b29373d7c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e04343-dedc-480e-87a6-b29373d7c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-41201894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6130f73-8643-4078-a03c-a519b4672cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c480068a2743ae987d90b7d71e176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='62bd19b1e83d4f7aa8a3facfefcd8e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee07d812-dc34-4def-bfc4-66abc2073887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee07d812-dc34-4def-bfc4-66abc2073887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cb4680-e6fd-4126-a127-70f78f943c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cb4680-e6fd-4126-a127-70f78f943c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6130f73-8643-4078-a03c-a519b4672cf6', 'volume_name': 'volume-a6130f73-8643-4078-a03c-a519b4672cf6', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7717874b-4356-420a-8551-7bf5e37d1ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7717874b-4356-420a-8551-7bf5e37d1ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dc91b5-3d46-4aa8-bbb6-2038284a6587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Volume a6130f73-8643-4078-a03c-a519b4672cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6130f73-8643-4078-a03c-a519b4672cf6', 'volume_size': 1} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (ceb97d4a-0f06-41e2-b627-c9993ef005e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f3fcc3-13a9-489c-8e7a-3ebe5f2d3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f3fcc3-13a9-489c-8e7a-3ebe5f2d3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706841148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d49797f-db0a-4df2-87ed-07ccdcebb23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192e21e1-9cfd-4c39-b85f-551500115e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192e21e1-9cfd-4c39-b85f-551500115e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221e40ed-14b3-42ee-8b44-9ce5d7cf9a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221e40ed-14b3-42ee-8b44-9ce5d7cf9a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d49797f-db0a-4df2-87ed-07ccdcebb23a', 'volume_name': 'volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014386ef-5726-4f91-b04c-49b2960bad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014386ef-5726-4f91-b04c-49b2960bad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6351b9c3-4890-422c-8276-1db100e1a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume 2d49797f-db0a-4df2-87ed-07ccdcebb23a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a', 'volume_size': 1} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-cd3c96df-8280-472b-9977-fd08ba1fbcbc" returned: 0 in 0.546s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-cd3c96df-8280-472b-9977-fd08ba1fbcbc" released by "delete_volume" :: held 1.072s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Created reservations ['96d62c00-0053-4ca6-af23-1fbf7edb2f89', 'a166bd23-3a97-452b-9e4e-36efa32eede1', 'c9b38f4e-6db6-4b1e-a8c1-8770ff19cf04', '658aad79-8466-4c9a-8799-2901d6f08048'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (b309878b-a2cb-424f-84c1-442a07d3fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86945f12-2139-4aae-a5dc-bf355526b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86945f12-2139-4aae-a5dc-bf355526b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513380884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0522621-997d-4033-9c36-f4e2eabedf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9313148-6fd2-44d3-8dbe-60312f35eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:56 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9313148-6fd2-44d3-8dbe-60312f35eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d49f04-238a-4af9-afaa-61154ad74f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d49f04-238a-4af9-afaa-61154ad74f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0522621-997d-4033-9c36-f4e2eabedf7c', 'volume_name': 'volume-c0522621-997d-4033-9c36-f4e2eabedf7c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9a2231-81bc-4351-a0ae-261a629baeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9a2231-81bc-4351-a0ae-261a629baeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b724710a-dd95-4f1a-a0d1-56c575022596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume c0522621-997d-4033-9c36-f4e2eabedf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0522621-997d-4033-9c36-f4e2eabedf7c', 'volume_size': 1} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:57 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:57 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (d4715c4b-50a8-4c84-9c7e-9ffb3e4e653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508d232e-5ba0-4254-91de-c84711d28e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508d232e-5ba0-4254-91de-c84711d28e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1226399698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bcb913-2af8-423d-b500-48e7e8b43ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ece7af-bfc6-44d5-bd46-283a951eb6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ece7af-bfc6-44d5-bd46-283a951eb6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce594bf-9269-407f-a6a1-5ca8e7a67133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce594bf-9269-407f-a6a1-5ca8e7a67133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bcb913-2af8-423d-b500-48e7e8b43ffc', 'volume_name': 'volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22384ecc-cfc9-49de-8e71-2c0764a282b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22384ecc-cfc9-49de-8e71-2c0764a282b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2097d3-3cf2-451d-8787-58ee182ed070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:57 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume b8bcb913-2af8-423d-b500-48e7e8b43ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc', 'volume_size': 1} Apr 22 09:04:57 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (d05d248e-06fd-4af1-88bd-575f1307e29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6cdb76-b77a-4e92-9373-84daf042cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-fe93aa43-a6b6-4f70-96a8-8712da8365b7-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6cdb76-b77a-4e92-9373-84daf042cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386455557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bf5ede-1551-49d6-8317-dc2ddddce2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:58Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a569c6-26b1-4f28-829b-0cde98e4af1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a569c6-26b1-4f28-829b-0cde98e4af1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c62fd-2d47-4535-9b69-64cd3082973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c62fd-2d47-4535-9b69-64cd3082973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71bf5ede-1551-49d6-8317-dc2ddddce2ce', 'volume_name': 'volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a64c1de-8e95-430a-8d50-57dc4f1866f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a64c1de-8e95-430a-8d50-57dc4f1866f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319127b3-7cda-4d39-9f96-7094c159fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:58 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume 71bf5ede-1551-49d6-8317-dc2ddddce2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce', 'volume_size': 1} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-fe93aa43-a6b6-4f70-96a8-8712da8365b7-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "cinder-quobyte-fe93aa43-a6b6-4f70-96a8-8712da8365b7" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-fe93aa43-a6b6-4f70-96a8-8712da8365b7" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8151190-86c7-4f7d-b91a-848fb7ff3089]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:58 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.443s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:04:58 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Deleted volume successfully. Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-10bb41a9-4b18-4a18-8b22-76603effad78 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-cd3c96df-8280-472b-9977-fd08ba1fbcbc-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:58 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 Apr 22 09:04:58 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:58 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" returned: 0 in 2.268s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00207bc-a535-4b40-bb7f-8a34938ac23c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:04:58 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:58 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:04:58 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:59 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7" returned: 0 in 0.500s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:59 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7 Apr 22 09:04:59 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:59 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.570s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:04:59 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Converted 1024.00 MB image at 451.28 MB/s Apr 22 09:04:59 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f is being set with open permissions: ugo+rw Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:59 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f Apr 22 09:04:59 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:59 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-fe93aa43-a6b6-4f70-96a8-8712da8365b7" returned: 0 in 0.404s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-quobyte-fe93aa43-a6b6-4f70-96a8-8712da8365b7" released by "delete_volume" :: held 0.941s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Created reservations ['5ac11c20-fb80-4363-96aa-cc0f70d2b60a', 'd55635ac-78e3-4d0e-b2d2-7f11c504bb64', 'a0226c08-f3d1-4ed5-bd2f-229a99bd7ee8', '6d9370da-a7ba-4fc1-915c-525539076883'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:59 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:04:59 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:59 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" returned: 0 in 0.415s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" released by "_copy_volume_from_snapshot" :: held 4.533s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c30cb70a-38a7-43dd-91a0-17f674210dbf-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" released by "_create_volume_from_snapshot" :: held 4.562s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.591s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.063s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293645331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3202ee-cd33-4918-8d34-c34140cb0f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating volume 9d3202ee-cd33-4918-8d34-c34140cb0f1f {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:04:59 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:04:59 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f 1073741824 Apr 22 09:04:59 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ba4421-a509-4cc0-9359-1730816caf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f', 'volume_size': 1, 'snapshot_id': 'c30cb70a-38a7-43dd-91a0-17f674210dbf'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b689185-568b-4a32-b664-fb9bdc331c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:04:59 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Volume volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f (c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f): created successfully Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b689185-568b-4a32-b664-fb9bdc331c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:04:59 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (bf4d24c0-c659-4a66-9525-de7c129b6b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:04:59 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ff2a11b3-6b85-4f6c-9b2d-65977259cb8c tempest-VolumeDependencyTests-990782098 None] Created volume successfully. Apr 22 09:05:00 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.418s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:00 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Deleted volume successfully. Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-be06f409-ce2f-461b-9316-e6451033e461 tempest-CreateVolumesFromImageTest-152059936 None] Lock "cinder-fe93aa43-a6b6-4f70-96a8-8712da8365b7-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:00 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f 1073741824" returned: 0 in 0.509s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:00 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f Apr 22 09:05:00 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:00 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f" returned: 0 in 0.440s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-41201894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6130f73-8643-4078-a03c-a519b4672cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c480068a2743ae987d90b7d71e176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='62bd19b1e83d4f7aa8a3facfefcd8e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Creating volume a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:00 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbbca6b-45e8-4cc0-8309-e17db9d81c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:00 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 1073741824 Apr 22 09:05:00 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaa4f80-8016-4ca5-ba63-fd957db7e19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:00 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f (9d3202ee-cd33-4918-8d34-c34140cb0f1f): created successfully Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaa4f80-8016-4ca5-ba63-fd957db7e19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (707f458f-2e78-4d91-b1ff-6b8ad6547247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:00 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-155eb387-edd6-4cdc-a4ee-c372cb553865 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created volume successfully. Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-c30cb70a-38a7-43dd-91a0-17f674210dbf-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-c30cb70a-38a7-43dd-91a0-17f674210dbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-c30cb70a-38a7-43dd-91a0-17f674210dbf" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c30cb70a-38a7-43dd-91a0-17f674210dbf" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Deleting offline snapshot c30cb70a-38a7-43dd-91a0-17f674210dbf of volume b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] snapshot_file for this snap is: volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb62f7-8a88-4384-8f3c-6ec48cc7bdbe]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:00 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:01 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf Apr 22 09:05:01 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:01 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 1073741824" returned: 0 in 0.602s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:01 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:01 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:01 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf" returned: 0 in 0.567s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[6504d934-f05a-4ee9-902a-dd7bc1807140]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:01 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:05:01 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:01 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.423s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.933s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706841148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d49797f-db0a-4df2-87ed-07ccdcebb23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating volume 2d49797f-db0a-4df2-87ed-07ccdcebb23a {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:01 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dc91b5-3d46-4aa8-bbb6-2038284a6587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6130f73-8643-4078-a03c-a519b4672cf6', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:01 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a 1073741824 Apr 22 09:05:01 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a48449d-b0a0-425e-a836-047937897b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:01 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Volume volume-a6130f73-8643-4078-a03c-a519b4672cf6 (a6130f73-8643-4078-a03c-a519b4672cf6): created successfully Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a48449d-b0a0-425e-a836-047937897b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:01 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Flow 'volume_create_manager' (1a1160d5-68aa-4b52-8605-26e945254ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:01 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-65dd4cdb-a6f1-46e2-9ff9-e481638fe392 tempest-SnapshotDependencyTests-1855806544 None] Created volume successfully. Apr 22 09:05:02 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.584s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:02 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf Apr 22 09:05:02 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Flow 'volume_create_manager' (23be0862-6522-456b-9768-3b7868097a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e21842-a161-457b-9938-00fd04b4cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e21842-a161-457b-9938-00fd04b4cd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632aebd8-13fa-4611-b2d2-3982894981f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452925da8401495ab7edd2192faff005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:02Z,use_quota=True,user_id='7441cbc7f7764ac69dd2f54356d8ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b01e41-c3a8-4cb1-aef7-abd9a7d3c927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b01e41-c3a8-4cb1-aef7-abd9a7d3c927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4b7f02-849e-43f0-8f80-3d94433a82a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4b7f02-849e-43f0-8f80-3d94433a82a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632aebd8-13fa-4611-b2d2-3982894981f7', 'volume_name': 'volume-632aebd8-13fa-4611-b2d2-3982894981f7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baafc09c-e431-49ed-9415-b229f74cecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baafc09c-e431-49ed-9415-b229f74cecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30847a01-9dfd-40e2-845e-14e5d5b51ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:02 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Volume 632aebd8-13fa-4611-b2d2-3982894981f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632aebd8-13fa-4611-b2d2-3982894981f7', 'volume_size': 1} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:02 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a 1073741824" returned: 0 in 0.607s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:02 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a Apr 22 09:05:02 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:02 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf" returned: 0 in 0.501s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:02 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf Apr 22 09:05:02 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:02 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a" returned: 0 in 0.400s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.749s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513380884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0522621-997d-4033-9c36-f4e2eabedf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating volume c0522621-997d-4033-9c36-f4e2eabedf7c {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:02 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6351b9c3-4890-422c-8276-1db100e1a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:02 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c 1073741824 Apr 22 09:05:02 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef6d1ff-163b-469f-acbc-ea51f97a335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:02 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a (2d49797f-db0a-4df2-87ed-07ccdcebb23a): created successfully Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef6d1ff-163b-469f-acbc-ea51f97a335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:02 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (ceb97d4a-0f06-41e2-b627-c9993ef005e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:02 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6747a319-52b3-42d1-bc45-1816c3965fc3 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created volume successfully. Apr 22 09:05:03 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64.c30cb70a-38a7-43dd-91a0-17f674210dbf" returned: 0 in 0.406s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c30cb70a-38a7-43dd-91a0-17f674210dbf" released by "_delete_snapshot" :: held 2.104s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" released by "delete_snapshot" :: held 2.116s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Created reservations ['b8f8d716-02f7-4d59-8751-2d2b4224f9f9', '94fc7028-d9ad-454c-a380-ee62a124e76d', 'a27bfb0f-50ba-4575-831b-6e893663624b', '1cccaf30-5881-4124-95bc-d1e751a6f4b0'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Delete snapshot completed successfully. Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4788d10d-68bb-4c7f-9af4-fe6fd0c1d295 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-c30cb70a-38a7-43dd-91a0-17f674210dbf-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:03 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c 1073741824" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:03 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c Apr 22 09:05:03 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:03 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c" returned: 0 in 0.380s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.814s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1226399698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bcb913-2af8-423d-b500-48e7e8b43ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:57Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating volume b8bcb913-2af8-423d-b500-48e7e8b43ffc {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:03 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b724710a-dd95-4f1a-a0d1-56c575022596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0522621-997d-4033-9c36-f4e2eabedf7c', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:03 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc 1073741824 Apr 22 09:05:03 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f492407e-542d-4956-92f2-4c94695608ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:03 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume volume-c0522621-997d-4033-9c36-f4e2eabedf7c (c0522621-997d-4033-9c36-f4e2eabedf7c): created successfully Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f492407e-542d-4956-92f2-4c94695608ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:03 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (b309878b-a2cb-424f-84c1-442a07d3fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:03 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6dc628ed-63fc-47ac-b1d2-0496f3789287 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created volume successfully. Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-b8f62e9f-b53c-4cec-9bad-4aba2c904e64-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-b8f62e9f-b53c-4cec-9bad-4aba2c904e64-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ebf9c4-4385-4f3d-ba3c-56b54eeeefd7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:04 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc 1073741824" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:04 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:05:04 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:04 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc Apr 22 09:05:04 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:04 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:04 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.479s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc" returned: 0 in 0.406s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.075s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386455557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bf5ede-1551-49d6-8317-dc2ddddce2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fd104e0a844314bde5febe2fdc80fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:04:58Z,use_quota=True,user_id='7ba8c85ffb7e44ff8d0346386c2cb63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:04 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64 Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Creating volume 71bf5ede-1551-49d6-8317-dc2ddddce2ce {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:04 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:04 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2097d3-3cf2-451d-8787-58ee182ed070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:04 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce 1073741824 Apr 22 09:05:04 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71406d6-bf40-44eb-b4c0-ba409524db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:04 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc (b8bcb913-2af8-423d-b500-48e7e8b43ffc): created successfully Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71406d6-bf40-44eb-b4c0-ba409524db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (d4715c4b-50a8-4c84-9c7e-9ffb3e4e653f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:04 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-786b8cff-49f4-437e-a3b0-3333b867d3b2 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created volume successfully. Apr 22 09:05:04 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:04 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-b8f62e9f-b53c-4cec-9bad-4aba2c904e64" released by "delete_volume" :: held 0.913s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Created reservations ['29d1986e-225f-4d43-8f66-00373249961a', '0525578c-744f-4e26-9fd8-b8c1da48e2ec', 'b380f484-1c6e-4fce-bbc1-953975c8d95c', 'd4102a47-fe42-4690-8a4f-9941d52993a0'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:05 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce 1073741824" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:05 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:05 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:05 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce Apr 22 09:05:05 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (655f19f9-8c0f-4f5c-9f4e-683a15a2c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75561dc-62b2-44d7-82ba-f0dddbd40e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75561dc-62b2-44d7-82ba-f0dddbd40e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-73499802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed7660-d335-4214-8352-dca182f6bdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb5f9d44a6f435a9f9af4c97a4d7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:05Z,use_quota=True,user_id='f39ffb0a4aba4f81a7eab13ceb101d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d390a5a9-44d3-467f-b01a-770645a5ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d390a5a9-44d3-467f-b01a-770645a5ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69bdd57-1c24-4311-a3d5-522b4bb9c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69bdd57-1c24-4311-a3d5-522b4bb9c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daed7660-d335-4214-8352-dca182f6bdfe', 'volume_name': 'volume-daed7660-d335-4214-8352-dca182f6bdfe', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aa6f64-7ccf-41b4-912e-d952959ecee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aa6f64-7ccf-41b4-912e-d952959ecee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f67d13-fe30-4ab2-837a-94b2052ef059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:05 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Volume daed7660-d335-4214-8352-dca182f6bdfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daed7660-d335-4214-8352-dca182f6bdfe', 'volume_size': 1} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:05 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.444s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Deleted volume successfully. Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-53103121-cf79-481d-b2cc-d3c0c8b0e8e4 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-b8f62e9f-b53c-4cec-9bad-4aba2c904e64-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:05 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.272s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632aebd8-13fa-4611-b2d2-3982894981f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452925da8401495ab7edd2192faff005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:02Z,use_quota=True,user_id='7441cbc7f7764ac69dd2f54356d8ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Creating volume 632aebd8-13fa-4611-b2d2-3982894981f7 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:05 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319127b3-7cda-4d39-9f96-7094c159fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:05 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 1073741824 Apr 22 09:05:05 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734d6dee-58aa-494b-ac1f-e9c08b7d9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:05 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Volume volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce (71bf5ede-1551-49d6-8317-dc2ddddce2ce): created successfully Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734d6dee-58aa-494b-ac1f-e9c08b7d9a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:05 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Flow 'volume_create_manager' (d05d248e-06fd-4af1-88bd-575f1307e29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:05 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-28760cfe-6785-4b00-82f7-52d6669281a1 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created volume successfully. Apr 22 09:05:06 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 1073741824" returned: 0 in 0.443s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:06 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 Apr 22 09:05:06 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:06 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7" returned: 0 in 0.416s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.147s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30847a01-9dfd-40e2-845e-14e5d5b51ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632aebd8-13fa-4611-b2d2-3982894981f7', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c8661-e432-4f15-a658-6314f0f19e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:06 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Volume volume-632aebd8-13fa-4611-b2d2-3982894981f7 (632aebd8-13fa-4611-b2d2-3982894981f7): created successfully Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c8661-e432-4f15-a658-6314f0f19e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Flow 'volume_create_manager' (23be0862-6522-456b-9768-3b7868097a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Creating offline snapshot 86a975b5-ed42-4071-81af-2fa469b37973 of volume a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:05:06 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-94d4b9e5-b3b4-4239-b21a-c419bdd64cbb tempest-CinderUnicodeTest-841232344 None] Created volume successfully. Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a4343-6c54-4e61-a88a-1846152751a0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:06 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:06 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-71bf5ede-1551-49d6-8317-dc2ddddce2ce-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-71bf5ede-1551-49d6-8317-dc2ddddce2ce-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-71bf5ede-1551-49d6-8317-dc2ddddce2ce" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-71bf5ede-1551-49d6-8317-dc2ddddce2ce" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b791a8-f76c-4c56-94d7-a74f7da2e90d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:06 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce Apr 22 09:05:06 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:06 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:06 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:06 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 1G Apr 22 09:05:06 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:07 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce" returned: 0 in 0.445s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:07 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce Apr 22 09:05:07 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:07 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 1G" returned: 0 in 0.490s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6130f73-8643-4078-a03c-a519b4672cf6 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:07 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6130f73-8643-4078-a03c-a519b4672cf6 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 Apr 22 09:05:07 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:07 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-71bf5ede-1551-49d6-8317-dc2ddddce2ce" returned: 0 in 0.417s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-71bf5ede-1551-49d6-8317-dc2ddddce2ce" released by "delete_volume" :: held 0.889s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['a2bc6bfa-2228-47bf-a6b2-c160c5685000', 'd89f7202-1e6e-44c1-9924-84393c39be35', '6b27aa1d-3d84-42ab-8203-770c86200908', '39588b87-c0cf-4bc8-b041-c8e0f92dc599'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:07 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:07 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Flow 'volume_create_manager' (6a837e08-6ac9-4cc7-9a85-5cb1c17b52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8e0625-c71b-40a3-b7e9-3ab71ddc4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-b8bcb913-2af8-423d-b500-48e7e8b43ffc-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8e0625-c71b-40a3-b7e9-3ab71ddc4128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1617828315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7057b5-5d0f-436a-aa9e-a85959839309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452925da8401495ab7edd2192faff005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:08Z,use_quota=True,user_id='7441cbc7f7764ac69dd2f54356d8ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7e184e-a5d3-46d2-820a-63214de64c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7e184e-a5d3-46d2-820a-63214de64c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f543ff8f-8b34-4a69-80d4-3fb03336c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f543ff8f-8b34-4a69-80d4-3fb03336c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7057b5-5d0f-436a-aa9e-a85959839309', 'volume_name': 'volume-de7057b5-5d0f-436a-aa9e-a85959839309', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e454ffad-8143-4329-8ed4-8f6331454ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e454ffad-8143-4329-8ed4-8f6331454ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67cf2de-9220-4883-8355-0fc0a5bf780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:07 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Volume de7057b5-5d0f-436a-aa9e-a85959839309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7057b5-5d0f-436a-aa9e-a85959839309', 'volume_size': 1} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-b8bcb913-2af8-423d-b500-48e7e8b43ffc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-b8bcb913-2af8-423d-b500-48e7e8b43ffc" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-b8bcb913-2af8-423d-b500-48e7e8b43ffc" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd982722-83d7-452f-9a38-c38315911ab4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:07 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc Apr 22 09:05:07 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:07 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6130f73-8643-4078-a03c-a519b4672cf6 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973" returned: 0 in 0.484s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:07 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 is being set with open permissions: ugo+rw Apr 22 09:05:07 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:07 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 Apr 22 09:05:07 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:08 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:08 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleted volume successfully. Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1f8aaa26-bae9-456e-a94b-37e914df21fb tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-71bf5ede-1551-49d6-8317-dc2ddddce2ce-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:08 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:08 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc Apr 22 09:05:08 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:08 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973" returned: 0 in 0.415s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:08 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info Apr 22 09:05:08 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:08 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b8bcb913-2af8-423d-b500-48e7e8b43ffc" returned: 0 in 0.402s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-b8bcb913-2af8-423d-b500-48e7e8b43ffc" released by "delete_volume" :: held 0.873s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['4173a7e3-8db4-4cce-9c17-50a6eb80c846', 'acef332b-56c9-4197-b3e0-d611d9707cc6', '0b9ce80e-c62d-4b9a-80af-d5e9b02880d7', 'c388b5b5-0d2a-49e9-93d2-bfdb339ab799'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:08 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info" returned: 0 in 0.401s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:08 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info is being set with open permissions: ugo+rw Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:08 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:08 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:08 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info Apr 22 09:05:08 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-c0522621-997d-4033-9c36-f4e2eabedf7c-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-c0522621-997d-4033-9c36-f4e2eabedf7c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-c0522621-997d-4033-9c36-f4e2eabedf7c" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-c0522621-997d-4033-9c36-f4e2eabedf7c" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e6d3f-6ad4-4513-8846-25cb77f2276c]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:08 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:08 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c Apr 22 09:05:08 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:09 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.417s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:09 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.info" returned: 0 in 0.415s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleted volume successfully. Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.777s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-73499802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed7660-d335-4214-8352-dca182f6bdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb5f9d44a6f435a9f9af4c97a4d7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:05Z,use_quota=True,user_id='f39ffb0a4aba4f81a7eab13ceb101d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Creating volume daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:09 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:09 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe 1073741824 Apr 22 09:05:09 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:09 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6377887e-c90d-4ea4-98f3-89355bfc3729 tempest-SnapshotDependencyTests-1855806544 None] Create snapshot completed successfully Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-ca353fb6-ddba-4156-9080-a26e00f72b0c tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-b8bcb913-2af8-423d-b500-48e7e8b43ffc-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:09 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c" returned: 0 in 0.472s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:09 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c Apr 22 09:05:09 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:09 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe 1073741824" returned: 0 in 0.498s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:09 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:09 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:09 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c0522621-997d-4033-9c36-f4e2eabedf7c" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Flow 'volume_create_manager' (da3a2f38-7153-4ae5-a2eb-582f4adc40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645e9370-d3ff-4fec-8014-f248dac8cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-c0522621-997d-4033-9c36-f4e2eabedf7c" released by "delete_volume" :: held 1.015s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645e9370-d3ff-4fec-8014-f248dac8cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eca124-4878-4028-9b18-f8e6c0e102e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c480068a2743ae987d90b7d71e176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86a975b5-ed42-4071-81af-2fa469b37973,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:10Z,use_quota=True,user_id='62bd19b1e83d4f7aa8a3facfefcd8e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a744f6c8-5ae3-456c-9b76-49d7c97a8f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a744f6c8-5ae3-456c-9b76-49d7c97a8f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d54ceae-6879-43f0-8c8c-a4f93ea6711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d54ceae-6879-43f0-8c8c-a4f93ea6711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5eca124-4878-4028-9b18-f8e6c0e102e2', 'volume_name': 'volume-b5eca124-4878-4028-9b18-f8e6c0e102e2', 'volume_size': 1, 'snapshot_id': '86a975b5-ed42-4071-81af-2fa469b37973'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473f0506-f6f1-46af-9ea1-e0211ba33b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473f0506-f6f1-46af-9ea1-e0211ba33b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a80e00a-a480-48e5-8622-3d6785432e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:09 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Volume b5eca124-4878-4028-9b18-f8e6c0e102e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5eca124-4878-4028-9b18-f8e6c0e102e2', 'volume_size': 1, 'snapshot_id': '86a975b5-ed42-4071-81af-2fa469b37973'} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['7c4d8dc9-9ea7-4d5e-abcf-a3a8ac8abdac', '7a54c101-be44-4e1a-a26d-a691da35aa9c', 'e1d56409-528f-42fa-897a-6e78b39aca51', '49c75e4a-b773-451e-8066-fd87318e4385'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:09 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:10 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:10 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:10 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.396s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.387s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1617828315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7057b5-5d0f-436a-aa9e-a85959839309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452925da8401495ab7edd2192faff005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:08Z,use_quota=True,user_id='7441cbc7f7764ac69dd2f54356d8ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Creating volume de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:10 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f67d13-fe30-4ab2-837a-94b2052ef059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daed7660-d335-4214-8352-dca182f6bdfe', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:10 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 1073741824 Apr 22 09:05:10 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6e6360-4f13-4f75-b231-0bad670c817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:10 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Volume volume-daed7660-d335-4214-8352-dca182f6bdfe (daed7660-d335-4214-8352-dca182f6bdfe): created successfully Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6e6360-4f13-4f75-b231-0bad670c817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (655f19f9-8c0f-4f5c-9f4e-683a15a2c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-388188cb-6af6-4ce5-8327-19b17ba28707 tempest-VolumeDependencyTests-990782098 None] Created volume successfully. Apr 22 09:05:10 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.393s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:10 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleted volume successfully. Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-b733012c-34d0-4fbe-8a50-9d1e68bc4748 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-c0522621-997d-4033-9c36-f4e2eabedf7c-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:10 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 1073741824" returned: 0 in 0.464s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:10 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 Apr 22 09:05:10 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (76d42504-1862-4420-b50d-78b3bcd9ff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8551de2c-1f69-4495-a705-ddb70ca08837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:10 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8551de2c-1f69-4495-a705-ddb70ca08837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-687906415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f65e22-7d09-46c9-95b9-2d8bee5580b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb5f9d44a6f435a9f9af4c97a4d7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=daed7660-d335-4214-8352-dca182f6bdfe,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:11Z,use_quota=True,user_id='f39ffb0a4aba4f81a7eab13ceb101d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c79a36-a256-416f-b1fb-2c1c864cf1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c79a36-a256-416f-b1fb-2c1c864cf1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9531f6b2-13b4-4076-9f7d-9bf7269a6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-2d49797f-db0a-4df2-87ed-07ccdcebb23a-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9531f6b2-13b4-4076-9f7d-9bf7269a6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '59f65e22-7d09-46c9-95b9-2d8bee5580b0', 'volume_name': 'volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0', 'volume_size': 1, 'source_volid': 'daed7660-d335-4214-8352-dca182f6bdfe', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d111a536-9e51-42e2-bf9f-8662342b9eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d111a536-9e51-42e2-bf9f-8662342b9eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85539706-84c5-418f-b494-f4bc51cddf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:11 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Volume 59f65e22-7d09-46c9-95b9-2d8bee5580b0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0', 'volume_size': 1, 'source_volid': 'daed7660-d335-4214-8352-dca182f6bdfe', 'source_volstatus': 'available'} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-2d49797f-db0a-4df2-87ed-07ccdcebb23a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-2d49797f-db0a-4df2-87ed-07ccdcebb23a" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-2d49797f-db0a-4df2-87ed-07ccdcebb23a" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:11 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309" returned: 0 in 0.460s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[980af54b-378d-425a-aef0-012e87d45267]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.165s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-quobyte-86a975b5-ed42-4071-81af-2fa469b37973-b5eca124-4878-4028-9b18-f8e6c0e102e2" by "_create_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67cf2de-9220-4883-8355-0fc0a5bf780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7057b5-5d0f-436a-aa9e-a85959839309', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaeff8e-e8a8-4dd6-bc42-57acf8c70fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:11 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Volume volume-de7057b5-5d0f-436a-aa9e-a85959839309 (de7057b5-5d0f-436a-aa9e-a85959839309): created successfully Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaeff8e-e8a8-4dd6-bc42-57acf8c70fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Flow 'volume_create_manager' (6a837e08-6ac9-4cc7-9a85-5cb1c17b52f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-86a975b5-ed42-4071-81af-2fa469b37973-b5eca124-4878-4028-9b18-f8e6c0e102e2" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Creating volume b5eca124-4878-4028-9b18-f8e6c0e102e2 from snapshot 86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-quobyte-b5eca124-4878-4028-9b18-f8e6c0e102e2" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:11 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-83af5633-a580-4bc7-80b3-c29a4e7f71f5 tempest-CinderUnicodeTest-841232344 None] Created volume successfully. Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-b5eca124-4878-4028-9b18-f8e6c0e102e2" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] snapshot: 86a975b5-ed42-4071-81af-2fa469b37973, volume: b5eca124-4878-4028-9b18-f8e6c0e102e2, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:05:11 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a Apr 22 09:05:11 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[486ef98e-db96-48f9-9d01-7a63a2ecccb6]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:11 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 Apr 22 09:05:11 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:11 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:11 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a Apr 22 09:05:11 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:11 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973" returned: 0 in 0.453s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6130f73-8643-4078-a03c-a519b4672cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77cd866-24e3-4beb-a6b1-3347488830bd]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:11 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:11 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:11 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:12 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-2d49797f-db0a-4df2-87ed-07ccdcebb23a" returned: 0 in 0.442s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-2d49797f-db0a-4df2-87ed-07ccdcebb23a" released by "delete_volume" :: held 0.928s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['d5846780-064b-4f70-95b6-c7f252d0185b', 'cd38b119-6db5-46f3-80dc-432c0f9a4372', 'd9ec419a-7376-41fd-999c-d59c2e197f38', '33747628-4ea0-4f6d-acba-10af25e647dd'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:12 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:12 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:12 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.513s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:12 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 Apr 22 09:05:12 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:12 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.394s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:12 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleted volume successfully. Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-06986589-bfce-4ce7-8b7e-c90e186baa56 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-2d49797f-db0a-4df2-87ed-07ccdcebb23a-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_service.periodic_task [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83774) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:12 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:12 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:12 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-9d3202ee-cd33-4918-8d34-c34140cb0f1f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-9d3202ee-cd33-4918-8d34-c34140cb0f1f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-9d3202ee-cd33-4918-8d34-c34140cb0f1f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:13 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-9d3202ee-cd33-4918-8d34-c34140cb0f1f" acquired by "delete_volume" :: waited 0.016s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:13 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7347af-fd29-47b0-a536-3afbb3d36957]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:13 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:13 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f Apr 22 09:05:13 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:14 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.280s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8616c403-cb58-4d96-86ab-614bf46676e6 None None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:14 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2" returned: 0 in 2.021s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[007d74d0-03ea-472a-96de-17de73630b9e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:14 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:14 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:14 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f" returned: 0 in 1.061s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:14 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f Apr 22 09:05:14 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:14 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.585s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:05:14 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Converted 1024.00 MB image at 506.45 MB/s Apr 22 09:05:14 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 is being set with open permissions: ugo+rw Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:14 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 Apr 22 09:05:14 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:14 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-9d3202ee-cd33-4918-8d34-c34140cb0f1f" returned: 0 in 0.429s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-9d3202ee-cd33-4918-8d34-c34140cb0f1f" released by "delete_volume" :: held 1.534s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['ca788fa5-a59b-448a-b47b-d8d1a828a9c7', '54ddfebd-dc05-4a2e-b04b-6bc9ea450536', '24cdcab8-3154-48d9-b5f8-e757a90ac0dc', '63f5fb9a-5e2b-4b56-944e-4627f8c8c567'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:14 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:14 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:14 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:15 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2" returned: 0 in 0.431s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-b5eca124-4878-4028-9b18-f8e6c0e102e2" released by "_copy_volume_from_snapshot" :: held 4.057s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-86a975b5-ed42-4071-81af-2fa469b37973-b5eca124-4878-4028-9b18-f8e6c0e102e2" released by "_create_volume_from_snapshot" :: held 4.078s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.122s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.177s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:15 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Cloning volume daed7660-d335-4214-8352-dca182f6bdfe to volume 59f65e22-7d09-46c9-95b9-2d8bee5580b0 Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a80e00a-a480-48e5-8622-3d6785432e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5eca124-4878-4028-9b18-f8e6c0e102e2', 'volume_size': 1, 'snapshot_id': '86a975b5-ed42-4071-81af-2fa469b37973'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c19252-ec76-4f1c-b6b8-a317a00a7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Creating offline snapshot 2973bc35-25b0-47cf-87c4-880786f8569f of volume daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:05:15 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:15 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Volume volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 (b5eca124-4878-4028-9b18-f8e6c0e102e2): created successfully Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c19252-ec76-4f1c-b6b8-a317a00a7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Flow 'volume_create_manager' (da3a2f38-7153-4ae5-a2eb-582f4adc40a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed2f7f3-5a0f-47c4-a9fc-0b989b4316de]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.426s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleted volume successfully. Apr 22 09:05:15 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8377e51c-62f9-492b-8c67-060f66048e02 tempest-SnapshotDependencyTests-1855806544 None] Created volume successfully. Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-9f99f5a1-ee40-45d6-b6a6-e2c09a4366e7 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-9d3202ee-cd33-4918-8d34-c34140cb0f1f-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:15 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:15 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-4555b43f-0ff8-4775-ae7a-c8e607da6fec-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-4555b43f-0ff8-4775-ae7a-c8e607da6fec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-a6e70f05-1546-467e-84f2-2970427a92a9" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-a6e70f05-1546-467e-84f2-2970427a92a9" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-4555b43f-0ff8-4775-ae7a-c8e607da6fec" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-4555b43f-0ff8-4775-ae7a-c8e607da6fec" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleting offline snapshot 4555b43f-0ff8-4775-ae7a-c8e607da6fec of volume a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] snapshot_file for this snap is: volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e18c0a-8be0-4e51-b8dc-f8c9bdda00e0]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:15 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec Apr 22 09:05:15 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:15 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:15 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:15 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f 1G Apr 22 09:05:15 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:16 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec" returned: 0 in 0.507s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e70f05-1546-467e-84f2-2970427a92a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb833580-79f2-447c-b338-ade84fdfa475]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:16 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 Apr 22 09:05:16 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:16 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f 1G" returned: 0 in 0.482s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daed7660-d335-4214-8352-dca182f6bdfe -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:16 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daed7660-d335-4214-8352-dca182f6bdfe -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f Apr 22 09:05:16 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-86a975b5-ed42-4071-81af-2fa469b37973-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-86a975b5-ed42-4071-81af-2fa469b37973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-quobyte-a6130f73-8643-4078-a03c-a519b4672cf6" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-a6130f73-8643-4078-a03c-a519b4672cf6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-quobyte-86a975b5-ed42-4071-81af-2fa469b37973" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-86a975b5-ed42-4071-81af-2fa469b37973" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Deleting offline snapshot 86a975b5-ed42-4071-81af-2fa469b37973 of volume a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] snapshot_file for this snap is: volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b86263-b882-4102-aa70-d8453ca1e0db]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:16 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 Apr 22 09:05:16 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:16 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9" returned: 0 in 0.523s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:16 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec Apr 22 09:05:16 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:16 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daed7660-d335-4214-8352-dca182f6bdfe -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f" returned: 0 in 0.451s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:16 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f is being set with open permissions: ugo+rw Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:16 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f Apr 22 09:05:16 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:16 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973" returned: 0 in 0.487s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6130f73-8643-4078-a03c-a519b4672cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[822344de-dc5a-4e20-97db-0b74d7c83f67]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:16 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:16 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:16 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:17 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec" returned: 0 in 0.467s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:17 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec Apr 22 09:05:17 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:17 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:17 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info Apr 22 09:05:17 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:17 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.505s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:17 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 Apr 22 09:05:17 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:17 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9.4555b43f-0ff8-4775-ae7a-c8e607da6fec" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-4555b43f-0ff8-4775-ae7a-c8e607da6fec" released by "_delete_snapshot" :: held 1.996s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-a6e70f05-1546-467e-84f2-2970427a92a9" released by "delete_snapshot" :: held 2.010s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:17 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info" returned: 0 in 0.438s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:17 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info is being set with open permissions: ugo+rw Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:17 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info Apr 22 09:05:17 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['00677e32-4724-4163-9d5f-c41f7e2e9b97', '1c107718-19fb-427b-9823-32470697a484', '379d5364-6b0a-495d-9d42-9d077efc03e9', '286c86f3-ce17-4f21-a441-3c3d82b0ef80'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:17 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Delete snapshot completed successfully. Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a56ee449-c5f5-4b59-8b37-1ada39cfc784 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-4555b43f-0ff8-4775-ae7a-c8e607da6fec-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:17 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973" returned: 0 in 0.447s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:17 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:17 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973 Apr 22 09:05:17 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:18 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.info" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-59f65e22-7d09-46c9-95b9-2d8bee5580b0" by "_copy_volume_from_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-59f65e22-7d09-46c9-95b9-2d8bee5580b0" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] snapshot: 2973bc35-25b0-47cf-87c4-880786f8569f, volume: 59f65e22-7d09-46c9-95b9-2d8bee5580b0, {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e890d-e348-49bd-b6df-f5237f3586b2]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:18 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f Apr 22 09:05:18 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:18 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6.86a975b5-ed42-4071-81af-2fa469b37973" returned: 0 in 0.400s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-86a975b5-ed42-4071-81af-2fa469b37973" released by "_delete_snapshot" :: held 1.885s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-a6130f73-8643-4078-a03c-a519b4672cf6" released by "delete_snapshot" :: held 1.894s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Created reservations ['fd948995-a674-4f38-974a-818f0d7c8ed6', '2cb63b0b-3bf6-4f6c-8854-3d95a0fe89fc', 'eed74c14-55a0-4133-bc00-7beef3adb90e', '1f8b43df-a2b3-4687-9e5c-b57217678c9d'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:18 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Delete snapshot completed successfully. Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-50955bb6-b5c4-478a-ab5f-29c44bcdb775 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-86a975b5-ed42-4071-81af-2fa469b37973-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-a6130f73-8643-4078-a03c-a519b4672cf6-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-a6130f73-8643-4078-a03c-a519b4672cf6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-quobyte-a6130f73-8643-4078-a03c-a519b4672cf6" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-a6130f73-8643-4078-a03c-a519b4672cf6" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa353982-e5e3-4108-8fe1-75af4c661890]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:18 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:18 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:18 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f" returned: 0 in 0.502s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daed7660-d335-4214-8352-dca182f6bdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Creating direct copy from snapshot {{(pid=83774) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f1431-ebc8-4763-a9ee-dbb6613cc0a9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:18 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:18 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-a6e70f05-1546-467e-84f2-2970427a92a9-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-a6e70f05-1546-467e-84f2-2970427a92a9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "cinder-quobyte-a6e70f05-1546-467e-84f2-2970427a92a9" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-a6e70f05-1546-467e-84f2-2970427a92a9" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ac2006-5fee-4796-bf9a-6e8e3a23f405]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:18 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:18 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 Apr 22 09:05:18 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:18 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.485s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:19 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6 Apr 22 09:05:19 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:19 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.512s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.utils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Path /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 not found in is_blk_device check {{(pid=83774) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:19 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 Apr 22 09:05:19 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:19 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9" returned: 0 in 0.456s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:19 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9 Apr 22 09:05:19 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:19 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6130f73-8643-4078-a03c-a519b4672cf6" returned: 0 in 0.470s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-a6130f73-8643-4078-a03c-a519b4672cf6" released by "delete_volume" :: held 0.985s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Created reservations ['e4399f8e-97ac-435b-ae4e-cefb024ac671', '7c164e9f-7dbc-4504-9725-34aa1be27523', '7a9efb59-6144-4599-9cf6-12c0cca33e6f', '8dc54d9f-80bd-47d3-90ea-78fa020c1393'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:19 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:19 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:19 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a6e70f05-1546-467e-84f2-2970427a92a9" returned: 0 in 0.633s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-quobyte-a6e70f05-1546-467e-84f2-2970427a92a9" released by "delete_volume" :: held 1.127s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:19 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Created reservations ['b5590fa0-1c0d-447c-a125-04a3b7085093', '6d486da8-6e32-4a89-b392-b762b48d676e', 'c689db54-ead7-4b22-b184-dc1f1bab69e8', 'b42812cf-9827-47f8-a6e5-e3d8d921b0ca'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:20 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:20 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-b5eca124-4878-4028-9b18-f8e6c0e102e2-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-b5eca124-4878-4028-9b18-f8e6c0e102e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "cinder-quobyte-b5eca124-4878-4028-9b18-f8e6c0e102e2" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-b5eca124-4878-4028-9b18-f8e6c0e102e2" acquired by "delete_volume" :: waited 0.022s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:20 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.278s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e303bfb-87be-4f3e-9f46-7786f716b0b9]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:20 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Deleted volume successfully. Apr 22 09:05:20 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-734135a9-fc16-4561-96c9-41ea01ea4676 tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-a6130f73-8643-4078-a03c-a519b4672cf6-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:21 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 Apr 22 09:05:21 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:21 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0" returned: 0 in 2.329s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ff667c-761f-465b-a79d-25680666df87]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:21 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 1.270s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:21 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Deleted volume successfully. Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6774918d-f715-41d3-9359-282b4fdce000 tempest-CreateVolumesFromSnapshotTest-1836576789 None] Lock "cinder-a6e70f05-1546-467e-84f2-2970427a92a9-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:21 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:21 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:21 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2" returned: 0 in 0.892s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:21 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:21 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2 Apr 22 09:05:21 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:22 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.628s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.image.image_utils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Image conversion details: src /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 {{(pid=83774) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 22 09:05:22 devstack cinder-volume[83774]: INFO cinder.image.image_utils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Converted 1024.00 MB image at 439.47 MB/s Apr 22 09:05:22 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 is being set with open permissions: ugo+rw Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:22 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 Apr 22 09:05:22 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:22 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-b5eca124-4878-4028-9b18-f8e6c0e102e2" returned: 0 in 0.478s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-quobyte-b5eca124-4878-4028-9b18-f8e6c0e102e2" released by "delete_volume" :: held 1.415s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Created reservations ['e5db27ca-7199-426a-8ce4-91c5ce0a5b4f', '0547b107-6f3c-41b6-91e1-c1ab454d3853', 'a9a2f494-2d79-4e1d-8876-497bea771498', 'ec5956b8-ad9d-4fb0-89b0-0201fe45d59a'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:22 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:22 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:22 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0" returned: 0 in 0.451s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-59f65e22-7d09-46c9-95b9-2d8bee5580b0" released by "_copy_volume_from_snapshot" :: held 4.464s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-2973bc35-25b0-47cf-87c4-880786f8569f" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-2973bc35-25b0-47cf-87c4-880786f8569f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Deleting offline snapshot 2973bc35-25b0-47cf-87c4-880786f8569f of volume daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] snapshot_file for this snap is: volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fede0ac-17b4-4db4-ab1b-04ee0d74a41d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:22 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f Apr 22 09:05:22 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:22 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:22 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Deleted volume successfully. Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-7c88275c-b081-497f-85a1-7bff5c1f482a tempest-SnapshotDependencyTests-1855806544 None] Lock "cinder-b5eca124-4878-4028-9b18-f8e6c0e102e2-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:22 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (0adeafe5-1f2e-46a8-937f-a38baec5d8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def6a687-f0fc-423c-8720-afe84a82180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def6a687-f0fc-423c-8720-afe84a82180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473621167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7c2b01-175a-4d8a-a633-340bcdde340a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:23Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02fc39a-c236-46fb-83c9-4870242bbefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02fc39a-c236-46fb-83c9-4870242bbefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c6c724-f0cf-494d-99ed-1d0b73aca96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c6c724-f0cf-494d-99ed-1d0b73aca96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7c2b01-175a-4d8a-a633-340bcdde340a', 'volume_name': 'volume-7f7c2b01-175a-4d8a-a633-340bcdde340a', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1704bf-eabb-406d-b3cd-c46caab52a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1704bf-eabb-406d-b3cd-c46caab52a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a56ee7e-e988-4903-91b4-bd40a60c0ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:23 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume 7f7c2b01-175a-4d8a-a633-340bcdde340a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7c2b01-175a-4d8a-a633-340bcdde340a', 'volume_size': 1} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:23 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f" returned: 0 in 0.550s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daed7660-d335-4214-8352-dca182f6bdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325b336-3a32-4602-a85b-1f0ffcabbff7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:23 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:23 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:23 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:23 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:23 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f Apr 22 09:05:23 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:24 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f" returned: 0 in 0.457s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:24 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f Apr 22 09:05:24 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:24 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe.2973bc35-25b0-47cf-87c4-880786f8569f" returned: 0 in 0.405s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-2973bc35-25b0-47cf-87c4-880786f8569f" released by "_delete_snapshot" :: held 1.925s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.254s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.363s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Creating offline snapshot 9f110623-4191-41f5-b439-f305d15bef39 of volume de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85539706-84c5-418f-b494-f4bc51cddf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0', 'volume_size': 1, 'source_volid': 'daed7660-d335-4214-8352-dca182f6bdfe', 'source_volstatus': 'available'}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57082f68-88bc-4765-857a-593db9984560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39f25e0-91ba-475e-a264-3618f9c53324]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:24 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Volume volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 (59f65e22-7d09-46c9-95b9-2d8bee5580b0): created successfully Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57082f68-88bc-4765-857a-593db9984560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Flow 'volume_create_manager' (76d42504-1862-4420-b50d-78b3bcd9ff6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:24 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-68e41513-1790-4385-9328-ad5f03af9d8c tempest-VolumeDependencyTests-990782098 None] Created volume successfully. Apr 22 09:05:24 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 Apr 22 09:05:24 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-daed7660-d335-4214-8352-dca182f6bdfe-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-daed7660-d335-4214-8352-dca182f6bdfe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-daed7660-d335-4214-8352-dca182f6bdfe" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-daed7660-d335-4214-8352-dca182f6bdfe" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1f3ea-67ce-4087-87e1-e5089e0a7bc4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:24 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:25 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:25 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:25 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309" returned: 0 in 0.585s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 1G {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:25 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 1G Apr 22 09:05:25 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:25 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.565s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:25 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe Apr 22 09:05:25 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:25 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 1G" returned: 0 in 0.519s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:25 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7057b5-5d0f-436a-aa9e-a85959839309 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:25 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7057b5-5d0f-436a-aa9e-a85959839309 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 Apr 22 09:05:25 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:26 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-daed7660-d335-4214-8352-dca182f6bdfe" returned: 0 in 0.474s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-daed7660-d335-4214-8352-dca182f6bdfe" released by "delete_volume" :: held 1.070s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:26 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7057b5-5d0f-436a-aa9e-a85959839309 -F qcow2 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39" returned: 0 in 0.434s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:26 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 is being set with open permissions: ugo+rw Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Created reservations ['aebe52d6-d8b9-445a-88e7-258e2d3b4b93', '784a4208-ccd5-485f-b4d2-19442cf58ef1', 'ba157b3c-4ad2-4d2a-99de-eb4706317a3c', 'c6553130-4428-495e-b79f-0be292896cf7'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:26 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 Apr 22 09:05:26 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:26 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:26 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:26 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.405s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:26 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Deleted volume successfully. Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-1d7ddbf1-57eb-48ff-a040-038eb06398a6 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-daed7660-d335-4214-8352-dca182f6bdfe-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:26 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39" returned: 0 in 0.552s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:26 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:26 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info Apr 22 09:05:26 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:27 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info" returned: 0 in 0.432s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:27 devstack cinder-volume[83774]: WARNING cinder.volume.drivers.remotefs [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info is being set with open permissions: ugo+rw Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-59f65e22-7d09-46c9-95b9-2d8bee5580b0-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Lock "cinder-59f65e22-7d09-46c9-95b9-2d8bee5580b0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:27 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info Apr 22 09:05:27 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-59f65e22-7d09-46c9-95b9-2d8bee5580b0" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-59f65e22-7d09-46c9-95b9-2d8bee5580b0" acquired by "delete_volume" :: waited 0.015s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[7615815a-78dd-43c4-9d62-fb32a73ab5c7]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:27 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 Apr 22 09:05:27 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:27 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.info" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.529s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473621167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7c2b01-175a-4d8a-a633-340bcdde340a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:23Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Creating volume 7f7c2b01-175a-4d8a-a633-340bcdde340a {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:27 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:27 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a 1073741824 Apr 22 09:05:27 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:27 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-ade5db80-e6d3-4e4c-944c-60c19cae0e36 tempest-CinderUnicodeTest-841232344 None] Create snapshot completed successfully Apr 22 09:05:27 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0" returned: 0 in 0.494s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:27 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0 Apr 22 09:05:27 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-9f110623-4191-41f5-b439-f305d15bef39-delete_snapshot" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-9f110623-4191-41f5-b439-f305d15bef39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-quobyte-de7057b5-5d0f-436a-aa9e-a85959839309" by "delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-de7057b5-5d0f-436a-aa9e-a85959839309" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-quobyte-9f110623-4191-41f5-b439-f305d15bef39" by "_delete_snapshot" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-9f110623-4191-41f5-b439-f305d15bef39" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Deleting offline snapshot 9f110623-4191-41f5-b439-f305d15bef39 of volume de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] snapshot_file for this snap is: volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 {{(pid=83774) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf708bc-fb33-4cb3-b40b-56b301f7d76e]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:27 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:27 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 Apr 22 09:05:27 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:28 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-59f65e22-7d09-46c9-95b9-2d8bee5580b0" returned: 0 in 0.515s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:28 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a 1073741824" returned: 0 in 0.583s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-59f65e22-7d09-46c9-95b9-2d8bee5580b0" released by "delete_volume" :: held 1.041s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:28 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a Apr 22 09:05:28 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Created reservations ['e5b32c94-8bb4-43dd-b29c-7a9f8500ff66', 'b2057211-feaf-4e0f-8fff-80594da1fed5', 'abbb5d1b-0c3d-443f-b770-6a27a33af3a5', 'e3ba65d3-bf12-4c87-838d-db46791295ea'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:28 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:28 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:28 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39" returned: 0 in 0.612s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de7057b5-5d0f-436a-aa9e-a85959839309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83774) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b5a9a3-3391-4ae7-961d-86bbb2c57234]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:28 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 Apr 22 09:05:28 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:28 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a" returned: 0 in 0.454s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a56ee7e-e988-4903-91b4-bd40a60c0ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7c2b01-175a-4d8a-a633-340bcdde340a', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6737d01c-d163-4a0d-843d-9dafbaa346f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:28 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume volume-7f7c2b01-175a-4d8a-a633-340bcdde340a (7f7c2b01-175a-4d8a-a633-340bcdde340a): created successfully Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6737d01c-d163-4a0d-843d-9dafbaa346f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (0adeafe5-1f2e-46a8-937f-a38baec5d8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:28 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8bba58ce-4a87-4b48-9cb7-fc37cd6fd850 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created volume successfully. Apr 22 09:05:28 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.544s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:28 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Deleted volume successfully. Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-913f933f-2219-4798-a906-f9a80ee9c36a tempest-VolumeDependencyTests-990782098 None] Lock "cinder-59f65e22-7d09-46c9-95b9-2d8bee5580b0-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:28 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309" returned: 0 in 0.525s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:28 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:28 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 Apr 22 09:05:28 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "cinder-quobyte-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec6b8e-adab-4684-99cb-49d1f0f4adc4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:29 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f Apr 22 09:05:29 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:29 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39" returned: 0 in 0.542s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:29 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39 Apr 22 09:05:29 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (adc1173e-da98-4679-a63e-24e2e81f5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0da348-c04d-4d37-b7d0-6be53765a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0da348-c04d-4d37-b7d0-6be53765a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150495429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3ada6c-43c9-4770-b015-bfd73630a455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2ff73f-d7f7-4fe6-96b5-930ad20de3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2ff73f-d7f7-4fe6-96b5-930ad20de3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341afcd2-14ca-49a0-b964-720f525024cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341afcd2-14ca-49a0-b964-720f525024cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3ada6c-43c9-4770-b015-bfd73630a455', 'volume_name': 'volume-8b3ada6c-43c9-4770-b015-bfd73630a455', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe76b0e3-c874-4ec1-bb86-180704314f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe76b0e3-c874-4ec1-bb86-180704314f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b565aa1-e6cd-4b85-be35-00e4ed63b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume 8b3ada6c-43c9-4770-b015-bfd73630a455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3ada6c-43c9-4770-b015-bfd73630a455', 'volume_size': 1} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150495429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3ada6c-43c9-4770-b015-bfd73630a455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Creating volume 8b3ada6c-43c9-4770-b015-bfd73630a455 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:29 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:29 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 1073741824 Apr 22 09:05:29 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (3d888094-f1f6-4a46-9531-bd252e149847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54056144-beab-4b53-a9af-a537b35910f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54056144-beab-4b53-a9af-a537b35910f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1637607069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c2cb54-5a92-4292-9406-f460b5fdb596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0711f71c-a64a-4f53-a1bd-a38a9ca547a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0711f71c-a64a-4f53-a1bd-a38a9ca547a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c082672-c8a4-4791-9119-4d9d6146f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c082672-c8a4-4791-9119-4d9d6146f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c2cb54-5a92-4292-9406-f460b5fdb596', 'volume_name': 'volume-03c2cb54-5a92-4292-9406-f460b5fdb596', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc75c10-657f-4805-88b9-3f95a9d362f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc75c10-657f-4805-88b9-3f95a9d362f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b1dd64-d827-4e50-ad3e-d69f1b2653db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:29 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume 03c2cb54-5a92-4292-9406-f460b5fdb596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c2cb54-5a92-4292-9406-f460b5fdb596', 'volume_size': 1} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" returned: 0 in 0.567s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:29 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:29 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f Apr 22 09:05:29 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (92a86dd5-6eed-4351-944f-28e78d89d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a714555-98f9-4134-b21d-edc5ccde397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a714555-98f9-4134-b21d-edc5ccde397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429259916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c8a605-63e0-4906-9ffe-613cc67335e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcdfa6d-3be9-460c-ae6d-77f223ca1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcdfa6d-3be9-460c-ae6d-77f223ca1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc9bd6b-3d9a-46a4-a368-69ee94992e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc9bd6b-3d9a-46a4-a368-69ee94992e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c8a605-63e0-4906-9ffe-613cc67335e8', 'volume_name': 'volume-f3c8a605-63e0-4906-9ffe-613cc67335e8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c500f0-4283-4774-8a5e-73be7f952f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c500f0-4283-4774-8a5e-73be7f952f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d616179-83c4-47d1-90f9-3fe5e7be3611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume f3c8a605-63e0-4906-9ffe-613cc67335e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c8a605-63e0-4906-9ffe-613cc67335e8', 'volume_size': 1} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309.9f110623-4191-41f5-b439-f305d15bef39" returned: 0 in 0.671s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-9f110623-4191-41f5-b439-f305d15bef39" released by "_delete_snapshot" :: held 2.402s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-de7057b5-5d0f-436a-aa9e-a85959839309" released by "delete_snapshot" :: held 2.416s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:30 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 1073741824" returned: 0 in 0.580s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Created reservations ['f1eea31a-be48-4609-bbee-15b00f745d4a', '9da9a945-4566-4b45-b86e-3af886472d02', '1f6d0796-f588-4172-bd8a-1cbfccb5ea17', 'a01f9191-47d4-4251-b769-ac62d7c7905e'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:30 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 Apr 22 09:05:30 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Delete snapshot completed successfully. Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-6f6e78c4-0a33-4561-8ada-3a1bf6469da9 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-9f110623-4191-41f5-b439-f305d15bef39-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (c808662d-186a-4378-9d58-2dbeff4205be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7297fbe-b7bc-45b6-8a3b-828045710741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7297fbe-b7bc-45b6-8a3b-828045710741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848754604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dec3cf-f01c-44d6-9d24-52af22dcb9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6e0ca0-6334-4bc5-b532-0d7732f1eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6e0ca0-6334-4bc5-b532-0d7732f1eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaee0aa-968e-4eba-aac8-d103bf3232d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaee0aa-968e-4eba-aac8-d103bf3232d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dec3cf-f01c-44d6-9d24-52af22dcb9ec', 'volume_name': 'volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f4b60-6e3e-42be-8fd5-2b64ebf7cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f4b60-6e3e-42be-8fd5-2b64ebf7cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5150115-fb5a-4001-af46-007592694acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume e2dec3cf-f01c-44d6-9d24-52af22dcb9ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec', 'volume_size': 1} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:30 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" returned: 0 in 0.539s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-quobyte-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f" released by "delete_volume" :: held 1.126s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Created reservations ['6c85a101-a3d0-4956-9ce3-ad03c232913d', 'b0ec0e0d-7cf5-42d6-8cdf-e97e6a2bda25', '391034d3-5f94-4490-95cd-6a7b48a93896', 'c31dbd43-3a0d-4e1f-9189-f4996b41d7d2'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83774) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (376a33d0-a2e1-4e6d-bb16-9688175674f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bd5522-2ec7-4ef2-873a-6bb61c9978d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bd5522-2ec7-4ef2-873a-6bb61c9978d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396513859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bd752b-4c87-4dd4-82a8-98e4a93e16fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:31Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f0d669-0573-4939-8a67-dafe2b376e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f0d669-0573-4939-8a67-dafe2b376e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c75c56b-583d-4e1b-8036-8c74d2b93533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c75c56b-583d-4e1b-8036-8c74d2b93533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2bd752b-4c87-4dd4-82a8-98e4a93e16fc', 'volume_name': 'volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fa7dea-7c58-40f5-8340-3e1d6aa8103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fa7dea-7c58-40f5-8340-3e1d6aa8103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5cbfee-fcae-4bde-9025-4eafecd057a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume a2bd752b-4c87-4dd4-82a8-98e4a93e16fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc', 'volume_size': 1} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:30 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:30 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:30 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455" returned: 0 in 0.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1637607069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c2cb54-5a92-4292-9406-f460b5fdb596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Creating volume 03c2cb54-5a92-4292-9406-f460b5fdb596 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b565aa1-e6cd-4b85-be35-00e4ed63b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3ada6c-43c9-4770-b015-bfd73630a455', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 1073741824 Apr 22 09:05:30 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a6b0a9-132e-4165-af41-f7f390d21293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume volume-8b3ada6c-43c9-4770-b015-bfd73630a455 (8b3ada6c-43c9-4770-b015-bfd73630a455): created successfully Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a6b0a9-132e-4165-af41-f7f390d21293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (adc1173e-da98-4679-a63e-24e2e81f5327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:30 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-5f137be5-ee21-4728-9b70-788ae13a876c tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created volume successfully. Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-de7057b5-5d0f-436a-aa9e-a85959839309-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-de7057b5-5d0f-436a-aa9e-a85959839309-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-quobyte-de7057b5-5d0f-436a-aa9e-a85959839309" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-de7057b5-5d0f-436a-aa9e-a85959839309" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[332b3da3-98a0-480d-855a-a4f25214f9f8]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:30 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:31 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 Apr 22 09:05:31 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:31 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.466s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:31 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Deleted volume successfully. Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-fbd8be66-17a6-45df-85e9-320b0bd2ae49 tempest-VolumeDependencyTests-990782098 None] Lock "cinder-c3f81bfd-9dd8-4eaa-9f6c-7d254aebcd8f-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:31 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 1073741824" returned: 0 in 0.489s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:31 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 Apr 22 09:05:31 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:31 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309" returned: 0 in 0.504s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:31 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309 Apr 22 09:05:31 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:31 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596" returned: 0 in 0.457s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429259916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c8a605-63e0-4906-9ffe-613cc67335e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Creating volume f3c8a605-63e0-4906-9ffe-613cc67335e8 {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:31 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b1dd64-d827-4e50-ad3e-d69f1b2653db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c2cb54-5a92-4292-9406-f460b5fdb596', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a4d4ff-e657-4b13-90bf-913abc556412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:31 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 1073741824 Apr 22 09:05:31 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:31 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume volume-03c2cb54-5a92-4292-9406-f460b5fdb596 (03c2cb54-5a92-4292-9406-f460b5fdb596): created successfully Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a4d4ff-e657-4b13-90bf-913abc556412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (3d888094-f1f6-4a46-9531-bd252e149847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:31 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-f1da5429-922c-49ce-958a-d5d0852340fd tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created volume successfully. Apr 22 09:05:31 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-de7057b5-5d0f-436a-aa9e-a85959839309" returned: 0 in 0.427s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-de7057b5-5d0f-436a-aa9e-a85959839309" released by "delete_volume" :: held 0.971s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:31 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Created reservations ['a82bc54d-c4ab-486c-a74f-d18cdf0742c5', '6851c25e-593b-4edb-ac0b-9ab01b9208f5', 'c484124b-2f33-4a43-8d46-de459fd0c9fc', '5c280d6b-fce1-4f41-98dd-d246db647f17'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:32 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:32 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-632aebd8-13fa-4611-b2d2-3982894981f7-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-632aebd8-13fa-4611-b2d2-3982894981f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "cinder-quobyte-632aebd8-13fa-4611-b2d2-3982894981f7" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-632aebd8-13fa-4611-b2d2-3982894981f7" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41af979-fc9d-4ef8-8225-270d05e92d72]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:32 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 Apr 22 09:05:32 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:32 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 1073741824" returned: 0 in 0.632s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:32 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 Apr 22 09:05:32 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:32 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.480s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Deleted volume successfully. Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4ebbab37-2436-4491-932b-8f058f144d42 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-de7057b5-5d0f-436a-aa9e-a85959839309-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:32 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7" returned: 0 in 0.604s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:32 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7 Apr 22 09:05:32 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:32 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8" returned: 0 in 0.484s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.435s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848754604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dec3cf-f01c-44d6-9d24-52af22dcb9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:30Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Creating volume e2dec3cf-f01c-44d6-9d24-52af22dcb9ec {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:32 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d616179-83c4-47d1-90f9-3fe5e7be3611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c8a605-63e0-4906-9ffe-613cc67335e8', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:32 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec 1073741824 Apr 22 09:05:32 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d540dbb-f2eb-4f4b-b297-4ba131908575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:32 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 (f3c8a605-63e0-4906-9ffe-613cc67335e8): created successfully Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d540dbb-f2eb-4f4b-b297-4ba131908575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:32 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (92a86dd5-6eed-4351-944f-28e78d89d822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:32 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8a124853-7ee7-4c4f-878f-36977f767c0e tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created volume successfully. Apr 22 09:05:33 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-632aebd8-13fa-4611-b2d2-3982894981f7" returned: 0 in 0.383s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-quobyte-632aebd8-13fa-4611-b2d2-3982894981f7" released by "delete_volume" :: held 1.010s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Created reservations ['081b997f-02e8-4d76-9781-33c40e968b67', '30d66add-2f3f-4f5c-8499-2bcdc4bda3b2', 'da397277-abfa-453a-b45f-1e8d855a3a1e', 'fa14cbe2-e5be-4ccc-a937-86fd2c4b9168'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:33 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:33 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:33 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec 1073741824" returned: 0 in 0.497s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:33 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec Apr 22 09:05:33 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:33 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.437s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Deleted volume successfully. Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-75202ac2-1f42-4961-9a74-8a063f0c6d53 tempest-CinderUnicodeTest-841232344 None] Lock "cinder-632aebd8-13fa-4611-b2d2-3982894981f7-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:33 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec" returned: 0 in 0.434s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.195s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396513859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bd752b-4c87-4dd4-82a8-98e4a93e16fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01470015026e4d6bb77f0795657185eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:05:31Z,use_quota=True,user_id='e21ca2dfceda47b693306db0d70e97c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f555f57b-b411-4fbd-846d-a6e383b35801),volume_type_id=f555f57b-b411-4fbd-846d-a6e383b35801)}" {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.remotefs [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Creating volume a2bd752b-4c87-4dd4-82a8-98e4a93e16fc {{(pid=83774) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Selected osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 as target Quobyte volume. {{(pid=83774) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:05:33 devstack cinder-volume[83774]: INFO cinder.volume.drivers.remotefs [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] casted to osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4 Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc 1073741824 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5150115-fb5a-4001-af46-007592694acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5868a059-90d8-4115-8cda-78d043adc949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:33 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc 1073741824 Apr 22 09:05:33 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:33 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec (e2dec3cf-f01c-44d6-9d24-52af22dcb9ec): created successfully Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5868a059-90d8-4115-8cda-78d043adc949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:33 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (c808662d-186a-4378-9d58-2dbeff4205be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:33 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-1bf19e6c-6ecf-4a91-bb79-5287680e96b4 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created volume successfully. Apr 22 09:05:34 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc 1073741824" returned: 0 in 0.463s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:34 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc Apr 22 09:05:34 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:34 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc" returned: 0 in 0.455s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'} {{(pid=83774) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5cbfee-fcae-4bde-9025-4eafecd057a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc', 'volume_size': 1}' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4cf0ea-7039-4aa7-895e-25e3f72a85ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:05:34 devstack cinder-volume[83774]: INFO cinder.volume.flows.manager.create_volume [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Volume volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc (a2bd752b-4c87-4dd4-82a8-98e4a93e16fc): created successfully Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4cf0ea-7039-4aa7-895e-25e3f72a85ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83774) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Flow 'volume_create_manager' (376a33d0-a2e1-4e6d-bb16-9688175674f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83774) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:05:34 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-9ac00c99-50f9-4d7b-8cc1-6213bb309817 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created volume successfully. Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:34 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-quobyte-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc" acquired by "delete_volume" :: waited 0.007s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[2645e247-b822-46ce-8be3-7317bcb9b68d]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:35 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc Apr 22 09:05:35 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:35 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc" returned: 0 in 0.449s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:35 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc Apr 22 09:05:35 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:35 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc" returned: 0 in 0.379s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc" released by "delete_volume" :: held 0.857s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created reservations ['3b3354b6-8748-4b05-aea8-003aef4e3c80', '16ec6cef-6985-4e44-877e-e66c8f989e98', '11e05853-51f7-41f5-a35e-d39a0e0b1533', '52d83ed2-2a46-4fea-a28e-5931e90c32b7'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:35 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:35 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:35 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-quobyte-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec" acquired by "delete_volume" :: waited 0.010s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d9ec8-82fe-4299-8418-d860de1136a3]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:36 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec Apr 22 09:05:36 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:36 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.405s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:36 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Deleted volume successfully. Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-db133df1-1a9d-4984-926a-28507b8a080f tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-a2bd752b-4c87-4dd4-82a8-98e4a93e16fc-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:36 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec" returned: 0 in 0.461s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:36 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:36 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec Apr 22 09:05:36 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:37 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec" returned: 0 in 0.385s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec" released by "delete_volume" :: held 0.867s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created reservations ['7356b589-b29a-47be-a2de-24ce65ea173a', 'f9478ce7-efad-4836-9e73-fbda5254ec4a', '29dc1c63-0e8a-4a9f-ba17-b85bb3407703', '95b43e88-d123-4e97-afa9-2af24809dfcf'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:37 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:37 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-f3c8a605-63e0-4906-9ffe-613cc67335e8-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-f3c8a605-63e0-4906-9ffe-613cc67335e8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-quobyte-f3c8a605-63e0-4906-9ffe-613cc67335e8" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-f3c8a605-63e0-4906-9ffe-613cc67335e8" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc038e-9daf-4e37-8e28-8eddfc535621]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:37 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 Apr 22 09:05:37 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:37 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.392s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:37 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Deleted volume successfully. Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-da8fa71e-0e90-404b-be99-047c8680f057 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-e2dec3cf-f01c-44d6-9d24-52af22dcb9ec-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:37 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8" returned: 0 in 0.450s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:37 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:37 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8 Apr 22 09:05:37 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:38 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-f3c8a605-63e0-4906-9ffe-613cc67335e8" returned: 0 in 0.407s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-f3c8a605-63e0-4906-9ffe-613cc67335e8" released by "delete_volume" :: held 0.879s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created reservations ['98083862-42d1-4d24-9039-ae6ac3f76bac', 'a03d453e-97ca-41b3-a4e9-3ae9bc9578f0', 'e40f2566-6714-43b4-9dcd-cae6bdaa2208', '4414a968-c9be-4acc-b4ff-c2d091e7c53c'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:38 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:38 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-03c2cb54-5a92-4292-9406-f460b5fdb596-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-03c2cb54-5a92-4292-9406-f460b5fdb596-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-quobyte-03c2cb54-5a92-4292-9406-f460b5fdb596" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-03c2cb54-5a92-4292-9406-f460b5fdb596" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42e7322-e3cf-42da-8701-c902afeda7c4]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:38 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 Apr 22 09:05:38 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:38 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.391s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:38 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Deleted volume successfully. Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-86a89225-5234-46bc-921b-78a47b7bbe92 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-f3c8a605-63e0-4906-9ffe-613cc67335e8-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:38 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596" returned: 0 in 0.449s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:38 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:38 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596 Apr 22 09:05:38 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:39 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-03c2cb54-5a92-4292-9406-f460b5fdb596" returned: 0 in 0.386s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-03c2cb54-5a92-4292-9406-f460b5fdb596" released by "delete_volume" :: held 0.855s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created reservations ['1efac42d-a125-4e83-b0cb-56b83c5eb549', 'b79cbb73-861e-4799-986e-ef7aff47a0a7', '27746be7-4029-4ba1-9784-5e1b1b2f3f75', '28298d88-bae3-4a85-bea5-8c58dcd0b42b'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:39 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:39 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-8b3ada6c-43c9-4770-b015-bfd73630a455-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-8b3ada6c-43c9-4770-b015-bfd73630a455-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-quobyte-8b3ada6c-43c9-4770-b015-bfd73630a455" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-8b3ada6c-43c9-4770-b015-bfd73630a455" acquired by "delete_volume" :: waited 0.008s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eadfd1-f103-412e-90ed-7031f9a72a57]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:39 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 Apr 22 09:05:39 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:39 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.395s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:39 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Deleted volume successfully. Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-8f3eec29-d0c6-4429-8fc0-db4108a6d301 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-03c2cb54-5a92-4292-9406-f460b5fdb596-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:39 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455" returned: 0 in 0.452s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:39 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:39 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455 Apr 22 09:05:39 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:40 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-8b3ada6c-43c9-4770-b015-bfd73630a455" returned: 0 in 0.380s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-8b3ada6c-43c9-4770-b015-bfd73630a455" released by "delete_volume" :: held 0.856s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=191,cinder:UPDATE=294,cinder:INSERT=62,cinder:DELETE=27 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=281,cinder:SELECT=224,cinder:INSERT=75,cinder:DELETE=25 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created reservations ['10887227-11a3-4468-96cc-28339a2f8060', 'ea9e3bd7-ce04-449c-86e4-734dc6a6f1e8', '027c878a-cdbb-4398-b9a7-f9950af50b1c', '8e18b3df-9f13-407e-b3e8-39f77c9a319b'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:40 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:40 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-7f7c2b01-175a-4d8a-a633-340bcdde340a-delete_volume" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-7f7c2b01-175a-4d8a-a633-340bcdde340a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "cinder-quobyte-7f7c2b01-175a-4d8a-a633-340bcdde340a" by "delete_volume" {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-7f7c2b01-175a-4d8a-a633-340bcdde340a" acquired by "delete_volume" :: waited 0.006s {{(pid=83774) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a82dc-d73c-43c7-a0fb-5a0ac1f84565]: (4, 'qcow2') {{(pid=84646) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:40 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a Apr 22 09:05:40 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:40 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.410s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:40 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Deleted volume successfully. Apr 22 09:05:40 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-4745d2c8-e596-46f2-af9a-ebab9f022be3 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-8b3ada6c-43c9-4770-b015-bfd73630a455-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:41 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a" returned: 0 in 0.462s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:41 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a Apr 22 09:05:41 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:41 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab/volume-7f7c2b01-175a-4d8a-a633-340bcdde340a" returned: 0 in 0.390s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-quobyte-7f7c2b01-175a-4d8a-a633-340bcdde340a" released by "delete_volume" :: held 0.879s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG cinder.quota [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Created reservations ['3212a988-9117-4a54-8f2a-39fd468e3e30', '47032b65-68af-45ab-acc9-60cef2419163', '2a4ccffc-fb54-41f2-88f2-1c241377f67b', '4c98f196-85b8-448d-ae40-e6c63aae566f'] {{(pid=83774) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4': None} {{(pid=83774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG cinder.volume.drivers.quobyte [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f77f132-0ecd-4ef1-a101-3025e3f242d4'] {{(pid=83774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.lockutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83774) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:05:41 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab Apr 22 09:05:41 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:05:41 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG oslo_concurrency.processutils [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15132191c9f03a2a1ba76892a8c588ab" returned: 0 in 0.417s {{(pid=83774) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:05:41 devstack cinder-volume[83774]: DEBUG cinder.manager [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Notifying Schedulers of capabilities ... {{(pid=83774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:05:41 devstack cinder-volume[83774]: INFO cinder.volume.manager [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Deleted volume successfully. Apr 22 09:05:42 devstack cinder-volume[83774]: DEBUG cinder.coordination [None req-a7e17a80-e14d-43a5-ae79-66036d7b6147 tempest-CreateVolumesFromSourceVolumeTest-2038971307 None] Lock "cinder-7f7c2b01-175a-4d8a-a633-340bcdde340a-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=83774) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:05:51 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:UPDATE=17,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:05:51 devstack cinder-volume[83774]: DEBUG dbcounter [-] [83774] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=83774) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}